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ABSTRACT 


To establish effective Command and Control in Combat 
Information Centers (CIC) onboard Navy ships, it is very 
important that CIC teams develop proficient coordination, 
communication, and teamwork skills. The Navy has supported 
several research programs to investigate probable methods 
for enhancing these skills; one such program is the Tactical 
Decision Making Under Stress (TADMUS) program. Alphatech, 
INC., conducted the Tactical Adaptation and Coordination 
Training experiment (TACT) as part of this program to study 
how Navy CIC teams adapt to changing tactical environments. 
This thesis analyzes data from the TACT experiment in order 
to identify differences between superior and good teams. 

Findings reveal that superior teams have better 
teamwork skills, experience higher subjective workloads, and 
have more confidence in their Tactical Action Officers. In 
addition, high stress caused teams to be less orientated 
towards teamwork and lowered their communication and 
coordination skills. 
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I. INTRODUCTION 


A. BACKGROUND 

Team performance depends heavily upon effective 
communication among team members (Davis et al, 1985, p. 
232). This is increasingly important in today's Navy, where 
teams are frequently required to deal with highly technical 
equipment and highly automated ships, capable of rapidly 
retrieving and processing vast amounts of data. This 
increased data throughput places a heavier burden on teams 
and demands effective team communications. One command and 
control center where effective team communications are 
paramount is the Combat Information Center (CIC) of a U.S. 
Navy ship, especially when the ship encounters highly 
stressful real world problems. The ability of a CIC team to 
deal with these problems depends heavily upon the ability of 
subordinates and superiors to develop effective 
communications. This, in turn, requires members of the team 
to know what communications are expected of them and to be 
able to accurately explain the communications that they 
receive (Rouse, Cannon-Bowers, and Salas, 1992, p.1302). 
Once they have developed this ability, CIC team members are 
capable of rapidly evaluating the large volume of data they 
receive and disseminating only the critical information 
necessary for the Tactical Action Officer (TAO) to 
accurately assess the current situation and make prompt 
decisions. 

Effective communication performance plays a leading 
role in determining the success of a CIC team; however, 
there are other factors that also play a role. Such factors 
include: effective team coordination, a team's confidence in 
one another, team members’ confidence in the leader (i.e., 
the TAO), a leader's confidence in the team (i.e., the 
subordinates), individual and team workload, a team's 
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experience level, and the ability of the team to adapt to 
changing environments. All of these factors are of interest 
to the U.S. Navy. There is particular interest in learning 
how these factors relate to effective team performance and 
the development of decision making skills. 

A specific area of interest to the Navy and this thesis 
is a team's ability to adapt these factors and decision 
making skills when entering stressful conditions, thus 
allowing the team to sustain superior performance. The Navy 
realizes that stress tends to change a team's method of 
operation. Specifically, stress causes a team to alter 
communication strategies and decision making processes. 
Exactly how are these communication and coordination 
strategies changed? How does stress affect a team's ability 
to adapt to changing environments? How does stress change a 
team's decision making processes? Recent studies have 
attempted to answer some of these questions. These studies 
have shown that exposure to intense stress impairs 
individual decision making and induces a tendency to offer 
solutions before all alternatives have been considered. 
Furthermore, stress causes the decision maker to scan these 
alternatives in a nonsystematic fashion (Keinan and 
Friedland, 1986, p.219). This nonsystematic process 
prevents the decision maker from establishing a familiar 
routine or pattern that can be used to review other 
alternatives that may be better than the one originally 
chosen. Unfortunately, the Navy has experienced some tragic 
effects of stress on the decision making process. One 
particular example is the downing of an Iranian passenger 
plane in 1988 by the USS Vincennes. The AAW (Anti-Air- 
Warfare Officer) relayed preliminary reports from his 
subordinates to his Captain that an aircraft assumed to be 
an Iranian F-14 had changed its flight path into an 
attacking profile and was both descending and increasing 
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speed. It was later determined that the AAW had not 
confirmed these reports and "Quick reference to the CRO 
(character read-out) on the console directly in front of him 
would have immediately shown increasing not decreasing 
altitude...." (Gough, 1992, p.6). The ship's recent 
skirmishes with Iranian Gunboats had probably produced an 
extremely stressful environment that hampered the AAW's 
decision making process and eventually caused him to 
overlook several other alternatives. These alternatives, if 
chosen, might have lead to the prevention of the shootdown. 

Having experienced the negative effects of stress, the 
Navy has devoted considerable time and research to programs 
that are investigating probable solutions by enhancing 
communication performance, coordination strategies, and the 
decision-making process for teams in stressful tactical 
scenarios. One such program is the Tactical Decision-Making 
Under Stress (TADMUS) program. The TADMUS program's primary 
objective is to develop techniques for training and 
supporting tactical commanders under operational conditions 
so that the likelihood of catastrophic failure, specifically 
in the area of target deconfliction in anti-air warfare 
(AAW) operations, is virtually eliminated (Entin, Serfaty, 
and Deckert, 1993, p. 1). The TADMUS program employs 
several companies and research institutions to conduct 
research in these areas. One company doing research under 
the TADMUS program is ALPHATECH. Their efforts seek to 
understand how CIC teams onboard Navy ships adapt to 
changing tactical environments. Furthermore, they are 
committed to understanding how team training and structural 
reconfiguration can contribute to the team's ability to 
successfully adapt its behavior to meet task demands 
(Serfaty, Entin, and Deckert, 1993, p. 1). ALPHATECH, in 
cooperation with faculty and students at the Naval 
Postgraduate School (NPS), Monterey, California, has 
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conducted prior studies to investigate these questions; such 
studies include the Situational Assessment In Navy Teams 
(SAINT) and Coordination In Hierarchical Processing 
Structures (CHIPS) experiments which were conducted at the 
Naval Postgraduate School. Test subjects involved students 
of the Joint Command, Control, and Communications (JC3) 
curriculum. The SAINT experiment was designed to study the 
effects of team leader feedback on situation assessment in 
distributed air defense teams. Findings include: feedback 
of the leader's current assessment lowers explicit 
coordination; feedback does not affect subjective workload; 
feedback increases error rates, and may affect error 
patterns (Gough, 1992, p. iii). The CHIPS experiment was 
designed to validate normative model predictions about 
hierarchical decision-making in a dynamic, distributed 
scenario (Armbruster, 1993, p. 15). Findings reveal that 
team performance declines when stress, increased risk, and 
increased feedback are introduced to subordinates in the 
team hierarchy. 

The most recent study conducted by ALPHATECH at NPS is 
the Tactical Adaptation and Coordination Training (TACT) 
experiment. The main goal of this thesis is to analyze data 
collected during the TACT experiment and identify 
characteristics that distinguish the very best performing 
teams from the lowest performing teams Primary analysis 
focuses on how the superior teams differ from the others in 
their use of communication and coordination strategies 
across stressful conditions. 

B. TACT EXPERIMENT 

1. Objective 

The TACT experiment is the third in a series of 
experiments designed by ALPHATECH to study team adaptation 
to stress. The TACT experiment has two objectives. The 
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primary objective is to investigate if CIC teams can be 
trained to improve their communication and coordination 
strategies and thereby enhance their overall performance. 
The secondary objective is to design and test a training 
procedure that focuses on developing the following skills in 
a CIC team: recognition of external and internal signs of 
stress for the team, acquisition of team-communication 
skills, learning different team-coordination strategies, and 
appropriate adaptation of the different strategies to 
various stress inducing operational conditions. (Entin, 
Serfaty, and Deckert, 1994, p. 1) The core premise driving 
the experiment is that highly effective teams develop a 
shared situational mental model of the task environment and 
a mutual mental model of team members' tasks and abilities. 
It is hypothesized that these mental models enable a team to 
develop decision-making and coordination strategies that 
allow it to adapt to changing environments and stresses. 
Furthermore, development of these models causes a team to 
shift from explicit to implicit communications. Before an 
overview of the TACT experiment is conducted, a discussion 
of mental models and explicit and implicit communications is 
necessary. 

2. Background and Theory of Mental Models 

Mental models are the mechanisms whereby humans 
generate descriptions of system purpose and form, 
explanations of system functioning and observed system 
states, and predictions (or expectations) of future system 
states (Rouse, Cannon-Bowers, and Salas, 1992, p. 1300). 
Referring to the TACT experiment, the term "System" refers 
to the CIC team, its intermember interactions, 
communications and coordination strategies, and its overall 
purpose or objective for carrying out assigned missions. 
The mental model definition is applied to the TACT 
experiment as follows: Generating descriptions of system 
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purpose and form refers to team members' ability to describe 
why the team has been formed (i.e., desired objectives) and 
how the team has been structured to produce optimal results. 
Explanation of system functioning refers to team members' 
ability to explain how the team members are supposed to 
interact with one another and how their collective efforts 
affect the outcomes of the scenario. Explanation of 
observed system states refers to team members' ability to 
access the team's current condition and determine the input 
that is required to help the team sustain a level of 
performance. In other words, what type of information 
transfer is necessary for team members to perform their jobs 
effectively. Lastly, generating predictions of future 
system states refers to team members' ability to predict the 
future conditions of the team. It also involves 
understanding the information required to propel a team to a 
desired state. Simply stated, developing mental models 
basically boils down to developing team familiarity. 

Past studies have examined the development of mental 
models in teams. They have found that teams that develop 
mental models tend to adapt to changing environments and 
stresses better than teams that do not develop mental 
models. In addition, effective teams develop a mental model 
of their common task that enables them to use team structure 
to maintain team coordination and performance under a wide 
range of conditions (Entin, Serfaty, and Deckert, 1994, p. 
4) . With this in mind, mental models can be broken down 
into shared mental models of the situation and task 
environment and mutual mental models of team members' tasks 
and abilities. Shared mental models of the situation and 
task environment allow team members to anticipate how the 
situation will evolve. It implies that team members have 
common knowledge about the situation, environment, and 
priorities (Entin, 1995). Mutual mental models allow a team 
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member to generate expectations of how other team members 
will respond, given current conditions. It involves team 
members being "in sync" with each other. One of the 
hypotheses generated from the TACT experiment is that teams 
that have developed a high level of congruence between their 
mental models, both shared and mutual, are able to make use 
of these models to anticipate the way the situation will 
evolve as well as the needs of the other team members. 
These teams will perform consistently better under a wide 
range of conditions (Entin, Serfaty, and Deckert, 1994, p. 
5) . 

Having grasped the concept of mental models, one can 
now see why ALPHATECH has incorporated them in the TACT 
experiment. Mental Models determine how a team 
communicates, how they use coordination strategies, and how 
they effectively adapt to stress. This is why ALPHATECH has 
placed emphasis on training techniques that help develop 
mental models within a team. In addition to the analysis 
mentioned earlier, this thesis plans to analyze whether 
superior teams in the TACT experiment use or develop mental 
models more than good teams. 

3. Explicit Versus Implicit Communication 

There are two types of communication within a team; 
explicit and implicit communication. Explicit communication 
involves specific communications that are usually 
transferred between team members upon request. In other 
words, for a team member to receive information, he must 
specifically prompt another team member for the information 
transfer. Implicit communication involves the transfer of 
information to another team member without that information 
being requested. The key to implicit communication is that 
it is communication pertinent to an individuals needs, not 
just communication transfer. The beauty of implicit 
communication is that it reveals the presence of shared 


7 


mental models within a team. A team's increase in the use 
of implicit communication indicates that team members are 
predicting the needs of others more frequently. Analysis of 
the data generated from the TACT experiment in this thesis 
shows superior teams shift towards implicit communications 
more than other teams. This would imply the development of 
mental models. 

4. Overview of the TACT Experiment 

The TACT experiment was designed to simulate 
operations in combat information centers (CIC) onboard Aegis 
capable ships. The experiment utilizes the Decision Making 
Evaluation Facility for Tactical Teams (DEFTT) lab that is 
located at Surface Warfare Officers School (SWOS) in Newport 
Rhode Island and the Naval Postgraduate School (NPS) in 
Monterey, California. The DEFTT simulation originated from 
the Tactical Anti-Submarine Warfare Instructional Trainer 
(TASWIT) and provides a relatively realistic abstraction of 
five CIC watch stations in "air-alley" found aboard Aegis 
capable platforms (Entin, Serfaty, and Deckert, 1994, p. 9). 

The TACT experiment employed 59 military officers and 
one civilian, 30 from SWOS and 30 from NPS. These officers 
were split into 12 five person teams and were tasked to 
perform situation assessment and contact deconfliction by 
correctly inferring the identity, and thus the intentions 
(i.e., potentially hostile or neutral), of detected air and 
surface contacts (Entin, Serfaty, and Deckert, 1994, p. 8). 
Each team was set up in a hierarchical arrangement. Four 
subordinate team members supported the Tactical Action 
Officer (TAO) by providing information that enabled the TAO 
to make decisions on a contact's identity, capability, and 
intention. The TAO was also responsible for deciding the 
actions to be taken regarding the contact. The four 
subordinate positions are: an Identification Supervisor 
(IDS), a Tactical Information Coordinator (TIC), an Anti Air 
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Warfare Coordinator (AAWC), and an Electronic Warfare 
Supervisor (EWS). 

Prior to the start of the experiment, the 12 teams were 
assigned to three training groups; each group had four 
teams. One group was the control group and received no 
extra training. Another group received TACT+ training that 
involved the use of periodic situation assessment updates by 
the TAO. The final group received TACT training that 
involved no situation assessment updates by the TAO. For a 
more detailed description of the training techniques used in 
the TACT experiment, refer to ALPHATECH's 1994 final report 
on Team Adaptation and Coordination Training or Lieutenant 
Commander Lonnie R. Green's 1994 thesis on the Effectiveness 
of Tactical Adaptation and Coordination Training On Team 
Performance In Tactical Scenarios. 

Prior to the start of the four data collection 
scenarios, teams were given an overview of the TADMUS 
project. They also received refresher training on the DEFTT 
simulator and watch station functions. To further 
familiarize them with TACT equipment and team dynamics, each 
team was given three practice scenarios. At the conclusion 
of the third practice session, the data collection scenarios 
commenced. Each team was run through two tactical 
scenarios, one high stress and one low stress. Data was 
collected using audio, video, trained observers, and team 
questionnaire forms. At the end of the second scenario, the 
teams received their perspective training intervention. At 
the conclusion of its training intervention, each team was 
run through two more tactical scenarios, one high stress and 
one low stress. Data was again collected, team members 
filled out background questionnaires, and the experiment 
concluded. A more detailed description of the TACT 
experiment is covered in the Experimental Design section. 


ALPHATECH's goal was to compare the data obtained prior 
to training with the data obtained after training to 
determine the effectiveness of the training interventions. 
More specifically, the data was analyzed to see if training 
intervention had an effect on a team's development of mental 
models. This was accomplished by identifying a team's shift 
from explicit to implicit communications. In contrast, the 
main focus for this thesis is the communication and 
coordination characteristics that distinguish superior 
teams, regardless of the training methods used to heighten 
team proficiency. 

C. THESIS STATEMENT OF WORK 

1. Scope 

This thesis focuses on distinguishing the differences 
in communication and coordination skills between superior 
and good teams. 1 More specifically, how do these 
communication and coordination skills differ between team 
subordinates and TAOs on superior and good teams. The 
communication and coordination data was collected over the 
entire course of the TACT experiment, under two main 
conditions of stress (low & high) , and over three time 
periods. 2 In terms of stress, this thesis seeks to 
distinguish how communication and coordination skills differ 
between superior and good teams in low versus high stress 
conditions, and how teams (regardless of being superior or 
good) differ in low versus high stress conditions. 


2 The 12 teams used in the TACT experiment are ranked from 
highest to lowest based on performance. The top 4 teams are 
called [superior], the bottom 3 teams are called [good]. 

2 Scenarios are divided into three time periods. Period 1: 
first 11 minutes, period 2: middle 6 minutes, and period 3: 
17 minute mark until the end. Communication and coordination 
data is collected for each specific time period. 
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Regarding time periods, each period has its own operations 
tempo (OPTEMPO) . 3 So, by analyzing how superior and good 
teams adapt their communication and coordination skills 
differently across the time periods, the thesis examines 
these adaptations across changing OPTEMPOs. The overall 
objective of the communication and coordination analysis is 
to determine whether subordinates, TAOs, and the team as a 
whole, for superior teams, develop implicit communication 
strategies across stresses and OPTEMPOS more than good 
teams. This again would imply that superior teams develop a 
mental model that allows them to adapt to changing 
environments and sustain a desired level of proficiency. 

After analyzing the communication data, the thesis 
turns its attention toward identifying other factors that 
distinguish superior teams from good teams. These factors 
are identified by analyzing data collected from several 
questionnaires: background questionnaires are analyzed to 
determine the differences in time at sea and time in CIC 
between members of superior and good teams, teamwork 
questionnaires are evaluated to determine the differences in 
teamwork skills between superior and good teams, team 
workload questionnaires are analyzed to establish whether 
superior teams differ from good teams in overall workload 
experienced across a scenario, and finally, post-mission 
questionnaires are analyzed to determine team members' 
confidence in one another and their ability to anticipate 
the actions and decisions of other team members. The 
communication variables and team questionnaires are 
explained in more detail in the experimental design section. 


3 OPTEMPO refers to the amount of workload that each period 
generates. Period 1 is low input workload, period 2 is 
increasing input workload, and period 3 is high and 
sustained input workload. 
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2. Anticipated Results 

The following results were anticipated for teams that 
participated in the TACT experiment: 

• Superior teams use implicit communication more 
than good teams. 

• Superior . teams increase their implicit 
communication rate more than good teams when 
entering high stress conditions. 

• Teams will be able to anticipate each other better 
in high stress versus low stress conditions. 

• Superior teams will adapt better than good teams 
to the change in operations tempo between the 
three time periods 

• TAOs on superior teams will have more past 
experience in CIC than TAOs on good teams. 

• Superior teams will have higher teamwork ratings 
than good teams. 

• Superior teams and their TAOs will report a higher 
workload rating delta in high versus low stress 
conditions than good teams and their TAOs 

• Superior teams will place more confidence in team 
members' ability to complete the mission. 

• Superior teams will be able to anticipate the 
actions and decisions of other team members better 
than good teams. 

These are only the main anticipated results. More specific 
anticipated results are discussed in the results section. 
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II. EXPERIMENTAL DESIGN 


A. OVERVIEW 

The TACT procedure is designed to train team members to 
adapt their coordination strategies to take account of 
changes in workload or stress (Entin, Serfaty, and Deckert, 
1994, p.4). Teams develop these strategies by participating 
in several tactical scenarios. Each scenario is developed 
with a high-workload/ambiguity version (scenario labels 1+ & 
2+) and a low-workload/ambiguity version (scenario labels 1- 
& 2-) (Entin, Serfaty, and Deckert, 1994, p.10). Thus, 

there are a total of four scenarios. It is assumed that 
the two high-workload scenarios (1+ & 2+) are functionally 
equivalent. In other words, they produce the same level of 
high stress for the teams. The two low-workload scenarios 
(1- & 2-) are also assumed to be functionally equivalent. 

They produce the same level of low stress for the teams. 
High stress scenarios differ from low stress scenarios in 
the total number of contacts that are introduced on the 
screen. High stress scenarios have a greater contact 
density than low stress scenarios. These pre-designed 
tactical scenarios are run in the DEFTT lab, which utilizes 
six personal computers to simulate CIC tactical displays of 
the scenario information. 

The individuals who participate in the tactical 
scenarios are divided into 12 teams, each consisting of five 
members. The teams structure is hierarchical, four 

subordinate team members work together to support a TAO's 
decision-making process. The teams' main function is to 
identify, track, evaluate and disseminate information on 
various surface and air contacts throughout the scenario. 
Experimental conditions are the same for all teams for the 
first two runs, after that, the teams receive different 
training interventions. Four teams are placed in a control 
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group, four in TACT intervention, and four in TACT+ 
intervention. After receiving the intervention training, 
the teams are exercised through two more scenarios. Data is 
collected and analyzed to determine if the training 
interventions have any effect on a team's ability to deal 
with stress. More specific details are provided in the 
following sections. 

B. SETUP 

This section describes the physical setup, the subjects 
involved, the graders' objectives, the experimental design, 
and the procedures followed from start to finish for the 
TACT experiment. 

1. Physical 

The physical setup of the TACT experiment is broken 
down into the following categories: DEFTT lab make-up, 
scenario composition, and task structure. 

a. DEFTT Lab 

The DEFTT lab provides users the capability of 
simulating CIC watch stations onboard Aegis capable ships. 
Referring to Figure 1, there are five watch stations that 
make up a CIC team. Each watch station is equiped with an 
IBM-AT 386 personal computer that simulates one operator 
workstation, providing either an Aegis display system, a 
command and display system, or an electronic warfare 
supervisor display system. The six personal computers are 
networked to a Hewlett-Packard 9000/345 experimental control 
station (ECS) that generates and controls experimental 
scenarios, supports a multi-channel communications system, 
and runs a Barco graphics Large Screen Display (Green, 1994, 
p. 12) . Each station has a headset and microphone that is 
used by team members to monitor internal and external 
communication channels (one channel per ear) . Team members 
are capable of communicating with each other as well as the 
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outside world. The outside world is handled by role players 
who simulate positions such as: 



Figure 1. DEFTT Layout 


Bravo Golf (battle group commander), Sea Snake (friendly SH- 
60 helicopter), commercial airliners, and other outside 
friendly, neutral or hostile forces. The DEFTT system is 
capable of time-stamped recording of all verbal 
communications among team members (Green, 1994, p. 12) . A 
primary function of DEFTT is to execute pre-planned 
scenarios that provide the problem environment and tasks for 
the subjects (Entin, Serfaty and Deckert, 1994, p. 10) . 

b. Scenarios 

The theater of operations for all DEFTT scenarios 
is the Arabian Gulf region. This region was chosen due to 
its realistic portrayal of high density air operations and 
potential for hostile developments. During an experimental 
run, team members are faced with various types of ambiguous 
situations and problems. These ambiguous situations and 
problems are developed over a scenario that lasts 
approximately 25-30 minutes. Furthermore, each scenario is 
divided into three periods. The first period is 11 minutes 
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long and involves low input workload. Teams are basically 
monitoring their screens and keeping track of potentially 
hostile situations. Period 2 is 6 minutes long and involves 
increasing input workload. The ambiguous situations and 
problems are starting to develop, and teams generally hit a 
peak workload level. Period 3 starts at the 17 minute mark 
and runs to the end of the scenario. Teams are still 
working to solve problems, but no new problems are 
introduced. The three time periods are continuous (subjects 
are unaware that the scenario is split into the three 
periods). 

Most stress within a scenario is generated by 
attempting target deconfliction on surface and air contacts, 
with a strong emphasis placed on the air picture. Some of 
the contacts are known and some are unknown. A scenario is 
filled with the following types of contacts: friendly 
surface/air, neutral surface/air, and hostile surface/air. 
Specifically, the surface picture includes contacts such as: 
friendly US Navy ships (FFGs, CGs, and CVs), neutral ships 
(tankers, fishing boats), and hostile ships (Boghammers). 
The air picture includes such contacts as: friendly US air 
(F-14s, F-18s, P3s), neutral air (commercial airliners), and 
hostile air (Foxbats, Mirages, Forgers). Facing this type 
of traffic, teams are presented with several tasks. 

c. Tasks 

The teams' primary task is to distinguish the 
identity of each contact and assess any potential dangers 
that it offers. Each individual team member is responsible 
for identifying, evaluating, and disseminating information 
which allows the TAO to make decisions on courses of action. 
Each member is tasked with keeping track of a part of the 
surface or air picture. The following list identifies 
specific roles of each team member: 
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• Identification Supervisor (IDS): usually tasked 
with identifying and tracking surface contacts. 

• Tactical Information Coordinator (TIC): usually 
tasked with assisting the AAWC in tracking all air 
contacts. He is occasionally assisted by the IDS. 

• Anti-Air Warfare Coordinator (AAWC): mainly 

responsible for tracking and taking action on 
potentially hostile air contacts that propose a 
threat to the ship or battle group. He is often 
considered the TAO's right-hand man. 

• Electronic Warfare Supervisor (EWS): tasked with 
identifying all electromagnetic signals and 
emitters. Is responsible for coordinating and 
correlating this information with other team 
members in order to correctly identify contacts. 

• Tactical Action Officer (TAO): tasked with making 
decisions based on the information received from 
his subordinates. The TAO manages and directs the 
team. The TAO usually has weapons release 
authority from the commanding officer. 

The roles and tasks just mentioned are not steadfast. It is 

only an example of how teams usually task their positions. 

At the beginning of the experiment, each team is given 

literature and training on the responsibilities of each 

position. However, freedom is left to the TAO to decide 

team organization. For example, some TAOs task the TIC with 

identifying all air and surface contacts between 0-180 

degrees while tasking the IDS with identifying all air and 

surface contacts between 180-0 degrees, thus splitting 

responsibilities for both the air and surface picture 

between the IDS and TIC. Other TAOs task the TIC with the 

Surface picture and the IDS with the air picture. Some TAOs 

have the TIC send warnings to potential threats and some 

have the AAWC send the warnings. Regardless of the set-up, 

the main task for the team is to correctly identify all 

contacts, evaluate their intentions, send warnings to those 

that offer potential harm, and take appropriate actions on 

those that fall under the rules of engagement (ROE). 
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2. Subjects 

Subjects included 59 military officers and 1 civilian. 
Thirty naval officers from Department Head School at the 
Surface Warfare Officers School (SWOS) located in Newport RI 
were placed into six teams, each team consisting of five 
members. Twenty-nine officers and one civilian from the 
Naval Postgraduate School located in Monterey, CA were also 
placed into six teams of five members. The breakdown of 
officers at NPS was: 14 Navy, 8 Air Force, 4 Army, and 3 
Marine. All subjects, with the exception of three navy, one 
Marine, eight Air Force, four Army, and one civilian, have 
time at sea. All members selected for TAO have past 
experience in that position. The ranks of the sixty 
subjects are distributed as follows: fifty-four 0-3s, four 
0-4s, one CW02, and one GS-12. 

For this thesis, 7 of the 12 teams used in the TACT 
experiment are analyzed. The 12 teams are separated into 3 
classes based on performance. Four teams are grouped at the 
top, five in the middle, and three at the bottom. The top 
four are considered the "superior" class, the middle five 
are considered the "very good" class, and the bottom three 
are considered the "good" class. The top four superior 
teams are compared to the bottom three good teams. The five 
teams in the middle class are not analyzed. Further details 
on class characterization of the seven teams are provided in 
the data description section. 

3. Graders 

Two active duty naval officers at NPS and two retired 
naval officers at SWOS were trained to use the observer's 
rating form (Appendix A). These officers were utilized to 
provide expert assessment of teamwork and performance. 
(Entin, Serfaty, and Deckert, 1994, p. 14) The observers 
were positioned to be able to view all watch stations during 
a scenario. Their main objective was to evaluate teams' 
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teamwork and performance skills as well as their overall 
anti-air warfare (AAW) performance. The later assessment is 
used by this author to distinguish between superior and good 
teams. Each observer was given headphones in order to 
monitor team communications. Also, an outline of the 
scenario was provided for them to follow along. 

ALPHATECH analyzed the agreement between the two NPS 
observers and between the two SWOS observers. They found 
the agreements to be quite high. Coefficient alpha equaled 
a very respectable 0.79, which was computed to assess 
overall inter-judge agreement (Entin, Serfaty, and Deckert, 
1994, p. 14). Coefficient alpha is the expected correlation 
(measure of reliability) between two tests when these tests 
claim to measure the same thing (Nunnally, 1967, p.197). A 
value of 0.0 implies that there is no agreement, a value of 
1.0 implies there is perfect agreement. It was therefore 
decided to average the two assessment ratings at each site 
into one overall rating. ALPHATECH performed other analysis 
on the four observers. They found that NPS observers were a 
little more lenient in their grading of performance outcome 
and teamwork. Because the design counter-balances all the 
experimental conditions across the two sites, the difference 
between the judges at the two sites was assumed to have no 
impact on experimental assessment (Entin, Serfaty, and 
Deckert, 1994, p. 15). 

Two psychologists were used to record CIC team 
communications. One observer recorded the TAO’s 

communications and the other observer recorded the 
subordinate 1 s communications. The CIC team communication 
recording form is found in Appendix A. These two observers 
were trained prior to the TACT experiment by observing video 
tapes of helicopter pilot communications. After 

approximately 16 hours of practice and discussion, the two 
coders (observers) attained an 85 percent agreement (Entin, 
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Serfaty, and Deckert, 1994, p. 15) . The observers were 
responsible for marking all communications within a 
scenario. Furthermore, effort was made to code 
communications for each specific time period. Therefore, 
the observers use a fresh rating form at the beginning of 
each new period. 

4. Statistical Design 

The statistical design used for the TACT experiment is 
a pre-test/post-test control group design that is modeled 
from Campbell and Stanley's Design 4 (Entin, Serfaty, and 
Deckert, 1994, p.18). There are three levels of 
experimental condition (control, TACT, and TACT+), two 
levels of training intervention (pre and post), and two 
levels of stress (low and high). These factors are 
completely crossed. Figure 2 depicts the experimental 
design for the TACT experiment. 
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Figure 2. Experiment Design After Entin et al 
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The primary tool of analysis for this thesis is the analysis 
of variance (General linear model - unbalanced design). The 
reader can see that all 12 teams received initial basic 
instruction and training. From there, each team was run 
through two scenarios, one high stress and one low stress. 
After these two scenarios, four teams received no 
coordination training (control), four teams received 
coordination training (TACT), and four teams received 
coordination training plus team information structure (TACT 
+ ) . The teams were then run through two more scenarios. 
Data was collected and the experiment concluded. 

C. PROCEDURES 

Prior to the start of the experiment, teams were 
divided into three experimental groups. Four teams were 
placed in the control group, four in TACT, and four in 
TACT+. Each of the three groups had two teams from NPS and 
two teams from SWOS. The experimental design was replicated 
at each site to control for site differences (Entin, 
Serfaty, and Deckert, 1994, p. 19) . Before the scenarios 
were conducted, all 12 teams were given basic instruction. 
The teams received refresher instruction on the DEFTT 
simulator and were given briefings on each watch station's 
functions and roles. The instruction was performed by NAWC- 
TSD agents and mostly involved instructions via written 
briefs or large screen display presentations. 

The 12 teams were then run through three practice 
scenarios. The first scenario involved DEFTT 
familiarization and basic buttonology learning. It also 
afforded team members the opportunity to familiarize 
themselves with their particular watch station roles. The 
second practice scenario afforded members further 
instruction on watch station roles. It also allowed team 
members the opportunity to familiarize themselves with 
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communication procedures and setup. The third practice 
scenario was used by team members to practice team building 
and tactics. During the three practice scenarios, NAWC-TSD 
agents were available to assist team members in DEFTT 
familiarization. 

Prior to the start of the first data collection 
scenario, teams received mission briefs regarding goals, 
threats, and rules of engagement. Furthermore, TAOs were 
afforded the opportunity to brief their teams. The teams 
filled out a pre-mission questionnaire and then started the 
scenario. At the end of the scenario, teams filled out a 
post-mission questionnaire. A short break was usually given 
between scenarios. Prior to the start of scenario two, the 
teams followed the same briefing procedures given in 
scenario one. The scenario was conducted, and at the 
conclusion, post-mission questionnaires were filled out and 
collected. Prior to the start of scenarios three and four, 
the teams were given their assigned intervention training. 
Upon completion of the training, the last two scenarios were 
conducted following the same procedures presented in 
scenarios one and two. At the end of the last scenario, 
team members also filled out a background questionnaire. 
Pre-mission questionnaires were only filled out prior to 
scenario one and three. During the TACT experiment, teams 
were exposed to low and high stress scenarios. The 
presentation of low and high stress level was counter¬ 
balanced over the four trials using an "abba" or "baab" 
ordering (Entin, Serfaty, and Deckert, 1994, p.21). The 
TACT experiment for the subjects was then concluded. 


D. ASSUMPTIONS 

There are four basic assumptions associated with the 
TACT experiment. They are: 

• DEFTT is a legitimate simulation of an Aegis CIC 
environment. 

• After initial familiarization training, all teams 
are near the same level of competence and 
understanding of the functionality/buttonology of 
their respective watchstations. 

• Observers' ratings of team performance are 

quantitatively consistent throughout the course of 
the experiment. 

• Subjects are willing and enthusiastic 
participants. 

The assumptions listed above are found in (Green, 1994, pp. 
17-18) . 

E. MEASURES 

There are several measures in the TACT experiment that 
are used to assess team performance. Some measures involve 
a team's evaluation of itself and other measures involve 
observer's evaluation of the team. There are seven basic 
data collection sheets. They are as follows: 

• Teamwork and Performance Observer's Rating Form 

• Overall AAW Team Performance Assessment Form 

• Pre-mission Questionnaires 

• Post-mission Questionnaires 

• Background Questionnaires 

• CIC Team Communication Recording Form for the TAO 

• CIC Team Communication Recording Form for the 

team. 

These data collection forms are found in Appendix A. All of 
these forms except the pre-mission questionnaire are used 
for analysis in this thesis. 
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1. Teamwork and Performance Rating Form 

These forms are rated by the four observers mentioned 
earlier. The teamwork and performance rating form is broken 
down into 15 items that are used to assess team performance. 
The 15 items are arranged to assess six dimensions of 
teamwork. The dimensions are as follows: 

• team orientation 

• communication behavior 

• monitoring behavior 

• feedback behavior 

• back-up behavior 

• coordination behavior 

Team orientation refers to the commitment team members have 
and exhibit to working together. Communication behavior 
involves the exchange of information between two or more 
team members in the prescribed manner, using proper 
terminology. Monitoring behavior refers to observing the 
activities and performance of other team members. Feedback 
behavior involves giving, seeking, and receiving information 
among members. Back-up behavior involves assisting the 
performance of other team members. Coordination behavior 
refers to team members executing their activities in a 
timely and integrated manner. (Entin, Serfaty, and Deckert, 
1994, p. B-2) The first question under each of the six 
dimensions of teamwork is considered the "key component" 
question and the alternate questions under the six 
dimensions are considered the "supporting" questions. 
(Serfaty, 1994) This thesis focuses on the key components. 
Each team is evaluated four times, twice during pre-training 
and twice during post-training. Again, the author is 
concerned with a team's performance at a point in time and 
is not concerned with the training methods used to get teams 
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to that point. Therefore, only post-training data is 
evaluated. 

2. Overall AAW Team Performance Assessment 

The questions on these forms are also assessed by the 
four naval officer observers located at NPS and SWOS. This 
form involves 12 items that are used to assess a team's 
overall AAW performance. Observers rate the teams in the 
following categories: 

• making radar detection reports 

• making ESM detection reports 

• identification/correlation reports 

• assessment of contacts' hostile intent 

• monitoring the threat 

• taking appropriate action in accordance with rules 
of engagement (ROE) 

• planning for upcoming mission 

• overall performance rating for this scenario 

• performance of critical events (four critical 
events). 

Again, post-training data is analyzed for this thesis and 
the author uses the data collected from these forms to 
identify superior and good teams. The method for 

distinguishing superior and good teams is described in the 
data description section. 

3. Pre-Mission Questionnaires 

The pre-mission questionnaires are administered prior 
to and after training. The questions are designed to assess 
the perceived congruence among team members of the mental 
model of the tactical situation. (Entin, 1994) The data 
generated from the pre-mission questionnaires is not 
analyzed in this thesis. 
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4. Post-Mission Questionnaires 

The post-mission questionnaire is filled out by team 
members at the end of each scenario. The questions are 
divided into two measuring devices. The first eight 
questions are used to assess a team's anticipation, 
confidence, and monitoring. The last six questions are 
comprised of Task Load Index (TLX) data that is used to 
measure a team's overall workload throughout each of the 
four scenarios. The TLX is a self-report subjective measure 
of workload that elicits a subject's ratings of six 
dimensions (mental demand, physical demand, temporal demand, 
performance, effort, and frustration) (Entin, Serfaty, and 
Deckert, 1994, p. 18). 

For this thesis, question number two of the TAO's 
questionnaire (TAO's confidence that other team members will 
complete the mission) is compared to question number one of 
the team members questionnaire (team confidence that the TAO 
will complete the mission). These two questions are 
analyzed to assess upward and downward confidence in 
superior and good teams. Questions three and four are not 
analyzed because they are reflected in the teamwork data 
mentioned earlier. Question number six of the TAO's 
questionnaire (TAO's ability to anticipate the actions and 
decisions of other team members) is compared to question 
number five of the team's questionnaire (team's ability to 
anticipate the actions and decisions of the TAO). These two 
questions are analyzed to assess upward and downward 
anticipation of superior and good teams. 

Finally, the TLX data is analyzed for superior and good 
teams. This thesis concentrates on average workload and TAO 
workload. Average workload involves the team as a whole 
(i.e., IDS, TIC, EWS, AAWC, and TAO) . TAO workload is self 
explanatory. The six dimensions of workload are not 
analyzed individually. They are combined into one overall 
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rating for the TAO and one rating for the team. Only the 
two post-training questionnaires are analyzed for this 
thesis. Furthermore, superior teams' post-mission 
questionnaires are compared to those of good teams. Team 
questionnaires are also compared between the low and high 
stress conditions to establish whether stress has an effect 
on a subjects perception of how the scenario unfolds. 

5. Background Questionnaires 

Background questionnaires are filled out at the end of 
the last scenario by team members. This questionnaire is 
designed to attain important background information on the 
experimental subjects. Two main areas of interest are 
analyzed. One area involves subject's time at sea and the 
other involves more specific information, mainly, subject's 
experience in CIC. This data is analyzed to identify and 
examine any differences in sea time experience between 
superior and good teams. There are two other areas of 
interest that are not analyzed in this thesis, yet they 
deserve to be mentioned. These two areas are training 
schools attended and last command position. The author 
hoped to be able to determine whether a team's prior 
training had any effect on team performance. However, the 
data collected from these two areas is widely dispersed and 
a method has not been determined for correctly rating a 
team's score. 

6. CIC Communication Recording Form 

The data collected from these forms comprises the main 
focus of this thesis. Referring to Appendix A, the data is 
collected separately on the TAO and Team. The form is 
designed to record data on two main types of communication, 
communication requests and communication transfers. 
Requests and transfers are further broken down into: 


27 


• requests for information 

• requests for action and task 

• request for problem solving and planning 

• transfers for information 


• transfers for action and task 

• transfers for problem solving and planning 

The two trained psychologists mentioned earlier evaluate 
communication patterns on each of the four scenarios. 
Furthermore, they evaluate each scenario across the three 
time periods. Whenever a new period within a scenario 
commences, they start recording on a new form. The two post 
training forms are analyzed for this thesis. 


F. UTILIZATION OF MEASURES 

The main composition of this thesis involves analysis 
of the communication data. The author identifies how 
superior teams differ from good teams in their development 
of communication patterns, and how superior teams adapt 
during the three time periods as compared to good teams. An 
analysis of how teams change their communications structure 
in high versus low stress conditions is also conducted. 
Communication use is not the only factor that distinguishes 
superior teams from good teams. This thesis also 
concentrates on the other factors mentioned in section E. 
After all analysis has been concluded, the author fuses the 
information from all the measures together to develop a 
clear characterization of the differences between superior 
and good teams. 
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III. DATA DESCRIPTION 


The TACT experiment data analyzed in this thesis was 
collected using several questionnaires and assessment forms. 
This section begins by describing how teams were placed into 
superior and good classes. Next, it identifies the 
communication variables used to monitor team communication 
performance and explains how these variables relate to one 
another. 4 This is followed by a description of other non¬ 
communication variables used to assess team performance. 

A. POST TRAINING DATA 

As explained in the experimental design section, 
subjects were exposed to four data collection scenarios, two 
pre-training and two post-training. Previous studies (Entin 
et al, and Green) compared the pre-training data to post¬ 
training data to analyze the effectiveness of training. 
This thesis focuses on distinguishing the characteristics of 
superior and good teams, regardless of the training 
techniques used to develop these characteristics; therefore, 
this thesis only analyzes post-training data. 

B. TEAM CHARACTERIZATION 

Data collected from the Overall AAW Team Performance 
Assessment Form (Appendix C) was used to select teams for 
assignment to the superior and good classes. This form, 
comprised of 12 questions, was used to assess team 
performance for several tasks and activities. These 12 
questions were answered by the observers for both low and 
high stress scenarios, resulting in twenty-four data points 
for each team. These 24 data points were averaged together 


4 The 56 communication variables are distinguished by 
alphanumeric identifiers (AC1 to AC56). Appendix B contains 
the list of communication variable identifiers. 
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to get an overall performance rating. The overall 
performance ratings for the 12 teams were ranked from 
highest to lowest and were examined to identify high and low 
clusters. The highest cluster consisted of four teams which 
were grouped into a class called (Superior), the lowest 
scoring cluster consisted of three teams which were grouped 
into a class called (Good). 5 Performance of the teams in 
these two classes is compared across several variables 
throughout the thesis to identify characteristics that can 
be used to distinguish between them. 

C. COMMUNICATION DATA 

The majority of the analysis in this thesis focused on 
the communication and coordination data, a collection of 
more than 56 dependent variables (Appendix B) . These 
variables were used to measure various aspects of 
communication and coordination within a team. The variables 
were grouped into the following communication categories: 
total communication (any utterance spoken); direction of 
communication (up, down, lateral, or outward); type of 
communication (requests, transfers, or acknowledgments); 
content of communication (information, actions & tasks, or 
problem solving & planning); combination of direction, type, 
and content of communication; and anticipation ratios. The 
variables and categories of communication are explained in 
the sections that follow. 


5 The Superior class has 4 teams and the Good class has 3 
teams due to natural grouping. Four teams were distinctly 
separated at the top, three teams distinctly at the bottom. 
Adding a fourth team to the good class or removing one from 
the superior class would skew the data. 
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1. Total Communication 

Communication was defined as any utterance that was 
spoken by a team member. Total communication (AC1) referred 
to the total number of utterances made by a team over the 
course of a scenario. Total communication rate (AC2) for a 
team is determined by dividing the total number of 
utterances in a scenario by the scenario length. For 
example, if 120 utterances were made in a 30 minute 
scenario, the total communication rate for a team would be 
120/30 = 4.0 per minute. To calculate the rate for a 
specific period within the scenario, total utterances for 
the period were divided by the period length in minutes. 
Total communication rate for a team was broken down into TAO 
and subordinate communication rate (AC3 & AC4). Subordinate 
rates were further broken down into TIC, IDS, AAWC, and EWS 
rates (AC5 to AC8 respectively); this was done so individual 
member's communication rate could be observed. 

2. Direction of Communication 

To help evaluate where communications within a team 
were being sent, four communication directions were created: 
upward, lateral, downward, and outward communication (AC9 to 
AC12 respectively). Upward communication involved 
communication that was sent from the subordinates to the 
TAO. Lateral communication was communication between 
subordinates. Downward communication involved communication 
that was sent from the TAO to subordinates. Outward 
communication was communication that was sent from the TAO 
to the outside world (non-team members) . The communication 
rates were determined by dividing the total number of 
utterances in a specific direction by the scenario length. 
If a team had an upward communication rate of 4.00, this 
meant that the team sent an average of four messages a 
minute to the TAO. Figure 3 depicts the communication 
direction layout (After Entin et al, p.30). 
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Figure 3. Communication Direction Layout 


After Entin et al, p. 30 

3. Type of Communication 

Communications were further grouped into three main 
types; requests, transfers, and acknowledgments. Request 
communications involved team members asking others to send 
some type of verbal message. Transfer communications were 
messages sent from one team member to another, without that 
message being requested. Acknowledgments were verbal 
communications that indicated a team member had received a 
message (e.g., "roger", "aye-aye", "I copy", "affirmative"). 
Total requests, transfers, and acknowledgments were 
collected for each team (AC14, AC15, and AC16 respectively). 
Total requests, transfers, and acknowledgments were further 
separated into TAO and subordinate's requests, transfers, 
and acknowledgments (AC16 to AC21). This afforded the 
opportunity to observe who, within a team, was sending these 
types of communication. 

4. Content of Communication 

Communications were divided into three categories 
based on contents: information, actions & tasks (A&T), and 
problem solving and planning (PS&P). Information 

communications were communications that requested or relayed 
the specifics of an entity. For example, they might 


32 











involve: asking for a contacts speed, supplying information 
on a contacts arrival, or asking a member what they hold on 
a certain bearing. Actions and tasks were communications 
that invoked a member to take some type of action. They 
also included a fnember telling another that an action had 
been taken (e.g., "AAWC, this is TAO, take track 2531 with 
birds", or "TAO, this is AAWC, at 20 miles I illuminated 
track 2531 with fire control radar"). Problem solving and 
planning were communications concerned with preparation for 
future events. For example, the TAO may say to the AAWC, 
"if track 2345 gets within 20 miles of the ship, illuminate 
it with our fire control radar." The TAO is sending a 
message that plans for a future event and includes a 
solution to the unspoken question of what to do when the 
contact closes to a certain proximity. Total information, 
AScT, and PS&P (AC22, AC23, and AC24 respectively) 
frequencies were collected for each team. This information 
was also tallied separately for TAOs and subordinates (AC25 
to AC30). 

5. Combination of Direction, Type, and Content 

This section describes variables that were made up of a 
combination of direction, type, and content. The reader 
should refer to the CIC Team Communication Recording Form 
(TAO or Team) located in Appendix A to see how the 
information for these variables was recorded. This section 
will describe the combination variables mainly by providing 
examples. 

There were two CIC Team Communication Recording forms 
that were filled out during a scenario, one for the TAO and 
one for the team (Appendix A) . These forms were completed 
by the two trained psychologists mentioned earlier. 
Whenever they heard a member communicate, they put a tally 
mark in the appropriate box that highlighted the specific 
content of the members communication. For example, suppose 
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the TAO sent the following message, "AAWC, this is TAO, take 
track 2345 with birds." The DIRECTION of the message is 
DOWNWARD to a subordinate, the TYPE of message is a REQUEST, 
and the CONTENT of the message is ACTION & TASK. Hearing 
this message, the recorders would put a tally mark in the 
(requests/action & task/AAWC) block. Some messages are 
counted in more than one communication variables; thus, 

these variables are not totally independent. For example, 
the message above would be counted in three different 
variables: total requests (AC13), total TAO requests (AC16), 
and total TAO request for actions & tasks (AC33) . To 

calculate total request rate (AC13), all tally marks placed 
in the 18 boxes under REQUESTS, for both TAO and Team 
recording forms, are tabulated and divided by the scenario 
length. To calculate TAO request for A&Ts rate (AC33), all 
tally marks on the TAO recording form in the blocks 

(requests/action & task/TIC-IDS-AAWC-EWS-ALL-OUT) are 
tabulated and divided by scenario length. All other 

communication variables were calculated using this method. 
The following are examples of communications that are 
recorded in more than one combination variable. Looking 
closely, the reader will see that these messages involve 
direction (upward, downward, lateral, or outward), type 
(request, transfer, or acknowledgment), and content 
(information, A&T, or PS&P). 

• request for information: "AAWC, this is TAO, what 

is the speed of track 1234?" "EWS, this is IDS, 
what do you have on a bearing of 270?" 

• request for action & task: "AAWC, this is TAO, 

send a warning to track 1234." "IDS, this is TIC, 
help me find track 1234." acknowledgment: "roger" 

• request for problem solving and planning: "IDS, 

this is TAO, when track 4321 gets within 20 miles 
of the ship, send a warning." IDS acknowledgment: 
"aye aye" 
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• transfer of information: "TAO, this is IDS, track 
2341 is an Iranian F-4. n TAO acknowledgment: 
"thanks M 

• transfer of action and task: "TAO, this is AAWC, 

at 15 miles I sent a second warning to track 

3456." TAO acknowledgment: "I copy" 

• transfer of problem solving and planning: "TAO, 

this is AAWC, at 12 miles I will send a third 

warning to track 3456." TAO acknowledgment: "OK" 

Figure 4 is a flow chart that depicts the relationships 

between the communication variables. This flow chart is 

based on the author’s view of the communication 

relationships. 



The chart is organized in a way that is conducive to the 
presentation of the communications variables in the results 
section. Viewing the chart, a team's total communications 
is comprised of total requests, transfers, and 
acknowledgments. A team's total requests is made up of TAO 
requests and subordinate requests. Furthermore, a TAO's 
total requests is broken down into requests for information, 
requests for A&Ts, and requests for PS&P. The same applies 
for subordinate requests. Turning to total acknowledgments, 
these are comprised of TAO and subordinate acknowledgments. 
There was no need to separate acknowledgments any further. 
Looking at total transfers, they were made up of TAO and 
subordinate transfers. TAO and subordinate transfers are 
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made up of TAO and subordinate transfers of information, 
transfers of A&Ts, and transfers of PS&P. Looking closer, 
the chart shows TAO and subordinate requests and transfers 
for problem solving and planning. Actually, the TAO' s 
requests and transfers are combined into one measure (i.e., 
Problem solving and planning rate of TAO, or AC27) . The 
same applies to subordinates. 

There are other ways of looking at the communication 
relationships. For instance, another person could split 
total communications into TAO and subordinate 
communications. TAO communications could then be broken 
down into TAO information communication, TAO A&T 
communication, and TAO PS&P communication. Each of these 
could be further broken down into requests and transfers. 
Again, this thesis looked at the relationships as presented 
in Figure 4 because they facilitated the presentation of 
results. 

6. Anticipation Ratios 

Anticipation ratio is the ratio of the number of 
transfers to X to the number of requests made by X. 
Hopefully, teams will have a large ratio of transfers to 
requests; this means that the member receiving the transfers 
is being anticipated by his team (i.e., the member requests 
little because the team anticipates his needs, and therefore 
transfer messages before the member has a need to request 
them). An anticipation ratio greater than one is 
interpreted to mean that a member's needs were being 
anticipated; this implies that the team was using implicit 
communications, which came about due to the development of 
mutual mental models. A large anticipation ratio indicated 
partial confirmation for mental models (Entin, Serfaty, and 
Deckert, 1994, p. 40). 

In the results section, this thesis uses the equation 
mentioned above (transfers to X/requests made by X) to 
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establish whether teams are anticipating one another better 
than other teams. The mean number of transfers is simply 
divided by the mean number of requests to come up with an 
anticipation ratio. For example, if the mean number of 
transfers is 3.3 per minute and the mean number of requests 
is 2.1 per minute, the anticipation ratio would be (3.3/2.1 
= 1.57). This is saying that there are 1.57 transfers for 
every request. ALPHATECH also had a number of variables 
that directly determined a teams anticipation ratio, these 
are identified as the anticipation variables (AC43 to AC56). 
The raw data generated from these variables were calculated 
using an equation that calculated a proportion of transfers 
to requests, i.e., (transfers to X) /(transfers to X + number 
of requests made by X). These numbers were then transformed 
into an anticipation ratio similar to the one mentioned 
above by using the equation (proportion of transfers)/(1 
proportion of transfers). This thesis uses the same 
equation for transforming the raw data (supplied to the 
author in the form of proportions) into an anticipation 
ratio for the anticipation variables (AC43 to AC56) . For 
example, take the variable that measures subordinate 
anticipation of information to the TAO (AC53). The raw data 
is averaged to be 0.621, which is a proportion. This thesis 
transforms this number into an anticipation ratio using the 
equation (0.621/(1 - 0.621) = 1.63). This number is the 
anticipation ratio that is reported for the anticipation 
variables in this thesis; it is the same as the anticipation 
ratio first mentioned in this paragraph, for every request, 
there are 1.63 transfers. 
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D. TEAMWORK DATA 

Teamwork questionnaires consisted of 15 questions that 
helped asses six dimensions of teamwork (Appendix A) . The 
spreadsheet for the teamwork data is located in Appendix C. 
Univariate analysis of variance was used to look for 
significant differences in the means of each of the 
dependent variables due to differences between the two 
classes, superior and good, and between the two stress 
levels, low and high, and to examine the interaction between 
class and stress. The data coding scheme for this data is 
similar to that of Table 6 (Appendix C). The main difference 
is that teamwork data is collected per scenario, there is no 
way to assess this data for individual periods within a 
scenario. 

E. POST-MISSION/TLX DATA 

Post mission questionnaires (Appendix A) were filled 
out by team members after each scenario. These 
questionnaires were designed to assess a member's 
perception- how they felt about the team's performance. The 
data spreadsheet is located in Appendix C. Analysis focused 
on superior and good teams in two main areas; the confidence 
that TAOs and subordinates had in each other (questions one 
and two) , and the ability of TAOs and subordinates to 
anticipate each other (questions five and six). Analysis 
was also conducted on the differences between TAOs on 
superior and good teams and between subordinates on superior 
and good teams. 

The Task Load Index (TLX) questions were a self-report 
subjective measure of the workload that a member felt during 
a scenario. The data collected for these questions are 
located at the end of the post-mission questionnaire 
spreadsheet in Appendix C. The TLX data was analyzed for 
average workload and TAO workload. Average workload refers 
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to the team's (TAO included) average workload. TAO workload 
is self explanatory. Effort was placed on distinguishing 
the differences in workloads between teams and TAOs on 
superior and good teams. 

F. BACKGROUND DATA 

The background data questionnaires are located in 
Appendix A. A summary of the data collected for superior 
and good teams is found in Appendix D. This thesis 
concentrated on the amount of time TAOs and subordinates 
spent at sea and in CIC. These times were compared between 
superior and good teams. Originally, interest was placed in 
linking prior training to TACT performance; however, the 
array of training schools attended by subjects was too 
diversified to establish relationships. 
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IV. RESULTS 


The dependent variables in this thesis were analyzed 
using Univariate analysis of variance, performed by the 
statistical package, MINITAB. All analysis was conducted 
using a significance level of a = 0.05. This quantity is 
the probability of rejecting the null hypothesis (fi l =fi 2 ) 

when the null hypothesis is actually true; and is often 
referred to as the Type I error rate. MINITAB computes p- 
values that represent the smallest value of a for which the 
null hypothesis can be rejected based on the observed data. 
When a is greater than or equal to the p-value, the null 
hypothesis is rejected, implying that the means of the 
dependent variables differ due to the relationships with the 
independent variables (i.e., class, stress or period). If a 
p-value is greater than 0.05, there is not sufficient 
evidence to suggest that the null hypothesis should be 
rejected. I.e., there is not sufficient evidence to 
conclude that the means of the dependent variable differ as 
a result of the settings of the independent variable. In 
this thesis, results with p-values (0.1 > p >0.05), are 
considered marginally significant. All significant and 
marginally significant results in this section are displayed 
with the means and p-values. 

A. ANALYSIS OF TEAMWORK 

This section describes the analysis of the effects of 
the independent variables class and stress, and the 
interaction of class and stress, on teamwork performance. 
Readers are encouraged to view the Teamwork and Performance 
Observer's Rating Form (Appendix A) as they follow this 
section. The variables, ATMl, ATM2...ATM15 refer to 
questions 1, 2,...15 respectively. Output for teamwork data 
is located in Appendix C. 
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1. Teamwork by Class 

Results indicate that superior teams have significantly 
better teamwork ratings than good teams. A summary of these 
results for all 15 teamwork measures is shown in Table 1. 
Concentrating on the key component questions under each of 
the six dimension of teamwork (highlighted in Table 1), the 
following results were found: 

• superior teams were oriented towards teamwork 

significantly better than good teams (ATMl, p = 
0.000) 

• superior teams communicated significantly better 
than good teams (ATM4, P = 0.000) 

• superior teams monitored each other's behavior 

significantly better than good teams (ATM7, p = 
0.000) 

• superior teams provided significantly better 

feedback to one another than good teams (ATM9, p = 
0.Oil) 

• superior teams provided significantly better 

backup to one another than good teams (ATMl0, p = 
0.001) 

• superior teams have significantly better 
coordinated behavior than good teams (ATM14, p = 
0.000) . 

Shifting to other non-key teamwork measures, the following 
results were also found: 

• superior teams had significantly less errors 

caused by inadequate team communication than good 
teams (ATM2, p = 0.000) 

• superior teams had significantly less errors 

caused by improper individual actions or decisions 
than good teams (ATM3, p = 0.007) 

• TAOs on superior teams provided significantly more 
tactical direction to subordinates than TAOs on 
good teams (ATM5, p = 0.000) 
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• subordinates on superior teams provided 
significantly more relevant tactical information 
to the TAO than subordinates on good teams (ATM6, 

p = 0.000) 

• TAOs on superior teams significantly anticipated 
the need to provide assistance to one or more team 
members more than TAOs on good teams (ATMll, p = 
0 . 002 ) 

• subordinates on superior teams anticipated the 
need to provide assistance to the TAO 
significantly more than subordinates on good teams 
(ATMl2, p = 0.001) 

In general, there is overwhelming evidence that teams with 
superior performance also have better teamwork skills. 


Variable 

key 

bolded 

Class 

Superior Good 

Stress 

Low Hiah 

m 

SS9 

ATM 1 

5.750 

2.733 

4.786 

4.129 

0.000 

0.055 

ATM 2 

5.325 

2.233 

4.414 

3.586 

0.000 

0.004 

ATM 3 

5.213 

2.983 

4.386 

4.129 

0.007 

0.818 

ATM 4 

5.887 

2.567 

4.671 

4.257 

0.000 

0.088 

ATM 5 

5.762 

2.667 

4.671 

4.200 

0.000 

0.072 

ATM 6 

5.588 

3.267 

4.843 

4.343 

0.000 

0.044 

ATM 7 

5.175 

2.850 

4.529 

3.829 

0.000 

0.078 

ATM 8 

5.500 

2.933 

4.629 

4.171 

0.000 

0.264 

ATM 9 

4.900 

2.817 

4.171 

3.843 

0.011 

0.622 

ATM 10 

5.150 

2.967 

4.443 

3.986 

0.001 

0.341 

ATM 11 

5.050 

2.717 

4.443 

3.657 

0.002 

0.179 

ATM 12 

5.300 

3.267 

4.843 

4.014 

0.001 

0.074 

ATM 13 

5.137 

2.633 

4.300 

3.829 

0.000 

0.274 

ATM 14 

5.925 

2.783 

5.029 

4.129 

0.000 

0.000 

ATM 15 

5.675 

2.667 

4.671 

4.100 

0.000 

0.073 


Table 1. Means and P-Values for Teamwork Measures 

2. Teamwork by Stress 

Across stress, results show that teams generally had 


higher teamwork ratings in low versus high stress 
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conditions. For the key measures, the following results 
were observed for low versus high stress conditions: 

• teams were oriented towards teamwork marginally 
more in low stress conditions (ATMl, p = 0.055) 

• teams communicated marginally better in low stress 
conditions (ATM4, p = 0.088) 

• team members monitored each other's behavior 
marginally more in low stress conditions (ATM7, p 
= 0.078) 

• teams behavior was coordinated significantly 
better in low stress conditions (ATMl4, p = 0.000) 

There was no significant difference between teams' feedback 

and backup behavior between stress levels, although, low 

stress conditions still produced better ratings for teams. 

For the non-key measures, there were two significant 
results: high stress conditions yielded more errors caused 
by inadequate communication (p = 0.004), and high stress 

conditions caused subordinates to send significantly less 
relevant tactical information to the TAO (p = 0.044). 

Overall, teamwork within a team seems to be effected by high 
stress conditions. 

3. Teamwork by Interaction of Class and Stress 

The interaction of class and stress produced only one 
significant finding; this occurred with the variable that 
measured the extent to which a team’s behavior was 
coordinated (ATMl4). Table 2 displays the means across this 
interaction (p = 0.007). 


1 

LOW 

HIGH 

SUPERIOR 

6.150 

5.700 

GOOD 

3.533 

2.033 


Table 2. Means for Coordination 
Behavior 

Viewing Figure 5, it is apparent that superior teams in both 
low and high stress conditions have better coordinated 
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behavior than good teams. Looking within teams, both 
superior and good teams had better coordinated behavior in 
low versus high stress conditions, again indicating that 
high stress had an effect on the team. In fact, stress 
effects goods teams coordination more than that of superior 
teams. 



Figure 5. Team's Behavior Coordination 


as a Function of Class and Stress 
Results similar to those above were also found for the 
remaining teamwork measures; however, they were not 
significant. The only measure that did not follow this 
pattern was ATM3; good teams actually had more errors in low 
stress conditions caused by improper individual actions or 
decisions. They had fewer errors in high stress conditions. 

Summarizing, superior teams had significantly better 
teamwork ratings than good teams. The independent variable, 
stress, did have an overall significant effect on teamwork 
ratings. Individually, there were some marginal effects and 
some significant effects. 

B. ANALYSIS OF COMMUNICATIONS 

This section presents the results of the analysis of 
the effects on the communication variables of the 
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independent variables; class, stress, and period. These 
results were generated using Univariate analysis of 
variance. Further analysis using the two sample t-test and 
the Mann-Whitney test is presented at the end of this 
section. This analysis was conducted to suplement the 
Univariate analysis results. 

1. Total Communication 

Initial analysis revealed that superior teams had more 
communications per scenario than good teams. Superior teams 
average 81.46 utterances per scenario, good teams average 
62.67, p = 0.027. Further analysis tended to contradict 
this finding and is provided at the end of this section. 
Dealing with stress, teams communicated marginally more in 
high versus low stress conditions (81.52 and 65.29 
respectively, p = 0.059). Teams probably communicated more 
in high stress conditions because the pace of the scenario 
created a sense of urgency within the team and forced team 
members to increase their communication rates just to keep 
pace with the scenario. Total communication also differed 
significantly across periods; this was probably at least 
partially due to the unequal lengths of each period. Longer 
periods naturally had more communications because there was 
more time to accumulate them. For this reason, all 
remaining communication variables were converted into 
communication rates by dividing the measures by the period 
length in minutes. 

2. Total Communication Rates 

To gain a better understanding of the communication 
results, it is important for the reader to see how team 
members proportioned total communications among themselves. 
Figure 6 displays the total communication percentages for 
members of superior and good teams. Notice that in both 
classes, a large portion of communications within a team was 
performed by the TAO. The TAO was the leader of the team 
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and was responsible for coordinating all activities within a 
team. Overall, TAOs on superior teams accounted for 
approximately 43% of the team's total communications, TAOs 
on good teams accounted for approximately 35%. 



Superior Good 

Figure 6. Percent Communication For Sup/Good Teams 
Looking at total communication rates between classes, 
results indicated that superior teams communicated at a 
significantly higher rate than good teams (7.667 comms/min 
and 6.250 comms/min respectively, p = 0.045). There is also 
a significant finding across stress; teams in high stress 
conditions communicate significantly more than teams in low 
stress conditions (8.044 comms/min & 6.076 comms/min, p = 
0.008). This was probably due to the fact that high stress 
conditions required higher rates of communication among team 
members (Entin, et al, p. 31) . Team members probably felt 
obliged to communicate more in order to keep pace with the 
scenario and sustain their input contributions to the team. 
There were no findings with regards to the interactions of 
class, stress, and period. The following patterns did 
emerge though; superior teams had higher communication rates 
than good teams in all three time periods, and superior 
teams had higher communication rates than good teams in both 
low and high stress conditions. 

As mentioned earlier, total communication rate within a 
team was divided into TAO communication rate (AC3) and 
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subordinate communication rate (AC4). There were some 
significant findings for these variables. TAOs on superior 
teams communicated at a significantly higher rate than TAOs 
on good teams (3.175 comms/min & 2.027 comms/mm, p = 

0.010). This was not the case for subordinates, there was 
no significant difference between communication rates for 
subordinates on superior and good teams. Combining these 
results - a significant difference in communication rate 
between teams (superior higher than good), a significant 
difference in communication rates between TAOs (superior 
higher than good), and no significant difference between 
communication rates for subordinates (almost the same) 
suggests that the significant difference in TAO 
communication rate was mainly responsible for the 
significant difference in team communication rate (team = 
TAO + subordinates) . The TAO played a major role in the 
make-up of team communications. Turning to stress, TAOs in 
high stress conditions had significantly higher 

communication rates than TAOs in low stress conditions 
(3.133 & 2.232 comms/min, p = 0.045) . The same is applied 
to subordinates (4.909 & 3.844 comms/min, p = 0.011). There 
are no significant differences for TAO and subordinate 
communication rates across the interactions of class, 
stress, and period. 

3. Direction of Communications 

Mentioned earlier, measures were created to track where 
communications within a team were being sent and the rates 
at which they were being sent. Figure 7 displays the 
breakdown of communications for superior and good teams with 
regards to direction. 
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Superior 









anticipating the needs of their commanders. TAOs also 
significantly increased their rate of communications to the 
outside world across the three time periods (p = 0.018). 

Looking at the main effects plot in Figure 8, the 
significant difference across periods appears to be the 
result of the large jump in communication rate between 
period one and two. 


Main Effects for Outward Communicaton Rate 

P = 0.018 



Figure 8. Main Effects for Outward 
Communication as a Function of Period 

TAOs seemed to be adjusting their outward communication 

rates in order to accommodate the increased demands 

generated by the high OPTEMPO that developed in period 2. 

TAOs also increased their rates in period 3, however, the 

difference in the change of rate between periods 2 and 3 was 

smaller than the change of rate between periods 1 and 2. 

The only other significant finding for outward communication 

came in the interaction of stress by period (p = 0.040), 

Table 3 and Figure 9 display the means across this 

interaction. Looking at Table 3, it is apparent that TAOs 

communicated more in high versus low stress conditions for 

periods 2 and 3, but the rates were nearly the same in 

period 1. 
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Table 3. Outward Means for Stress by Period 
Viewing Figure 9, an interesting occurrence appeared in 
period 2 under the high stress condition; TAOs sharply 
increased their outward communication rates. This was 
probably due to the combination of the high stress condition 
and the increased OPTEMPO that period 2 generated. TAOs 
were probably trying to adjust their outward communication 
rates to meet these demands. There was also an increase in 
outward communication rate for period 3, however, TAOs in 
both high and low stress conditions had nearly the same 
change of rate. 



as a Function of Stress and Period 
Although not significant, there were some interesting 
patterns that develop in upward, lateral, and downward 
communications that warrant discussion. First, subordinates 
on superior teams communicated more with their TAOs than 
subordinates on good teams, subordinates on superior teams 
communicated more with each other than subordinates on good 
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teams, and TAOs on superior teams communicated more with 
subordinates than TAOs on good teams. These patterns were 
found to exist for each of the three time periods, TAOs and 
Subordinates on superior teams always had higher rates. 
Second, across stress, subordinates on both superior and 
good teams had higher upward and lateral communication rates 
in high versus low stress conditions, and, TAOs on both 
superior and good teams had higher downward communication 
rates in high versus low stress conditions. Figure 10 shows 
the last remaining significant finding. Subordinates on good 



as a Function of Class and Stress 

teams had higher lateral communication rates than subordinates 
on superior teams in low stress conditions. This role was 
reversed in high stress conditions, possibly suggesting that 
subordinates on superior teams shifted to a more adaptive 
strategy under high stress. 

4. Type of Communication 

Mentioned in the data description section, 
communication was categorized into total team transfers of 
communication and total team requests for communication. 
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These requests and transfers were further broken down into 
TAO and subordinates requests & transfers. 

a. Total Team Requests 

Two significant differences were found for total 
request rate; these findings came across stress, and the 
interaction of stress and period. Teams had significantly 
higher request rates in high versus low stress conditions 
(2.294 & 1.553 requests/min, p = 0.002). As stated earlier, 
there are more contacts on a member's display screen in high 
stress conditions; thus, teams might have requested more 
because there were more contacts to inquire about. The 
interaction of stress by period was also significant (p = 
0.046). Looking at the interaction plot in Figure 11, teams 
in high stress conditions had higher request rates than 
teams in low stress conditions for periods 2 and 3. This 
was not the case for period 1, both stress conditions 
yielded almost identical rates, with high stress conditions 
actually having lower request rates. The significant 
difference in the interaction of stress and period appeared 
to be the result of the large jump in request rate from 
period 1 to period 2 for high stress conditions. This jump 
most likely was attributed to the high stress condition. 
Since teams in low stress conditions actually decreased 
their request rate in period two, where the OPTEMPO 
increased, and teams in high stress conditions increased 
theirs, it would appear that this difference was mainly due 
to the independent variable, stress, and not due to the 
OPTEMPO of period 2. 
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Stress 

• Low 
■ High 


Figure 11. Total Request Rate as a Function 
of Stress and Period 

b. TAO and Subordinate Requests 

Findings reveal that TAOs on superior teams had 
marginally higher request rates than TAOs on good teams 
(0.992 & 0.672 requests/min, p = 0.071). Across stress, 

TAOs and subordinates had significantly higher request rates 
in high versus low stress conditions (1.080 & 0.629 

requests/min, p = 0.013 for TAOs, and 1.215 & 0.924 

requests/min, p = 0.011 for subordinates). An interesting 
occurrence appeared in subordinate request rate between 
superior and good teams. Subordinates on good teams 
actually had a significantly higher request rate than 
subordinates on superior teams (1.239 & 0.9421 requests/min, 
p = 0.013). This is important to know because TAOs on good 
teams had significantly lower transfer rates than TAOs on 
superior teams (0.779 vs. 1.236 transfers/min, p = 0.012). 
The implication is that subordinates on good teams are 
requesting more because their TAOs are transferring less. 
Looking at this from another view, subordinates on superior 
teams are requesting less because their TAOs are 
transferring more. Another possible reason why subordinates 
on good teams have significantly higher request rates is 


Total Request Rate 

P = 0.046 
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because their TAOs have significantly lower acknowledgment 
rates. The implication here is that subordinates might be 
sending repetitive requests because their TAOs are not 
acknowledging these requests (Entin, 1994) . 

c. Total Team Transfers 

Analysis revealed that superior teams had 
significantly higher transfer rates than good teams (3.633 & 
3.062 transfers/min, p = 0.042). Superior teams were 

sending more messages without them being requested. This 
finding was expected because it implied that superior teams 
were probably using implicit vice explicit communications. 
An interesting occurrence that was noted was; superior teams 
had higher transfer rates than good teams, yet their request 
rates were almost identical. One might have expected their 
request rates to be significantly lower because their 
transfer rates were significantly higher. Within superior 
teams, only subordinates had significantly lower request 
rates as expected. Digging deeper, this was not due to 

subordinate transfers to subordinates, it was due to TAOs 
transfers to subordinates. The finding above - that 
superior teams had significantly higher transfer rates than 
good teams - is therefore actually due to TAO transfers and 
not subordinate transfers. Another interesting occurrence 
was that TAOs on superior teams had higher request rates 
than TAOs on good teams, despite the fact that subordinates 
in both classes had almost identical transfer rates to their 
TAOs. In other words, TAOs on superior teams requested 
j^ore, even though the same amount was transferred to them. 
This might suggest that these TAOs were aware of other 
important information that TAOs on good teams did not 
recognize. For example, TAOs on good teams might have asked 
for the bearing and range of a contact that was threatening 
the ship. TAOs on superior teams would have taken this a 
couple of steps further, requesting more information about 


the same contact. TAOs on superior teams might at first 
have asked for the bearing and range of the contact, but 
this would be followed by further requests for track 
history, possible emitters, altitude, IFF codes, and status 
of CAP. The TAO on the superior team was much more aware of 
the information needed to develop a picture of the current 
situation. Turning to the effects of stress on transfers, 
stress also had a significant effect on a team's transfer 
rate; teams in high stress conditions had significantly 
higher transfer rates than teams in low stress conditions 
(3.831 & 2.945 transfer/min, p = 0.003). This again 
possibly suggests that the nature of the high stress 
condition is forcing teams to communicate more. There were 
no other significant findings for total transfers, however, 
the following patterns did emerge: superior teams had higher 
transfer rates than good teams in both low and high stress 
conditions; and, superior teams had higher transfers rates 
than good teams in all three time periods. 

d. TAO and Subordinate Transfers 

Findings show that TAOs on superior teams have 
significantly higher transfer rates than TAOs on good teams 
(1.236 & 0.779 transfers/min, p = 0.012). There is also a 
significant difference across the time periods (p = 0.034). 
Figure 12 displays the main effects plot for TAO transfer 
rate across the three time periods. Notice the large jump 
in TAO transfer rate from period 1 to period 2. This again 
is probably due to the increased OPTEMPO in period 2. TAOs, 
recognizing this change in OPTEMPO, probably feel obliged to 
transfer as much information to their team as possible in 
order to keep them informed. They also might be changing 
their transfer rate to a more adaptive strategy in order to 
cope with the pace of period 2. Although not significant, 
an interesting pattern is, TAOs on superior teams have 
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higher transfer rates than TAOs on good teams across all 
three time periods. 


Main Effects for TAO transfer Rate 


P = 0.034 



Figure 12. Main Effects for TAO Transfer 
Rate as a Function of Period 

Turning to subordinate transfers rates, the only significant 
finding came with stress. Subordinates in high stress 
conditions had higher transfer rates than subordinates in 
low stress conditions (2.631 & 2.063 transfer/min, p = 
0.005) . 

e. Total Acknowledgments 

There was only one significant finding for total 
acknowledgments; superior teams had significantly higher 
acknowledgment rates than good teams (2.102 & 1.278 
acknowledgments/min, p = 0.013). Breaking this down, TAOs 
on superior teams had significantly higher acknowledgment 
rates than TAOs on good teams (0.947 vs. 0.575 acknow/min, p 
= 0.031) and subordinates on superior teams had marginally 
higher rates than subordinates on good teams 1.154 vs. 0.704 
acknow/min, p = 0.089, t-test p = 0.054) Reviewing other 
findings, it was stated that subordinates on superior teams 
had almost the same rate of transfers as subordinates on 
good teams. Since TAOs on superior teams had significantly 
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higher acknowledgments, despite no difference in subordinate 
transfers, this would imply that they were acknowledging 
more than TAOs on good teams because they simply understand 
the importance of responding to a message (i.e., letting the 
other members know the message had been received so it 
doesn't have to be sent again). Subordinates on superior 
teams have marginally more acknowledgments than subordinates 
on good teams probably because their TAOs are transferring 
significantly more. 

5. Combination of Direction, Type, and Content 

Recapping earlier discussion, TAO and Subordinate 
requests and transfers were broken down into requests and 
transfers of information, actions and tasks, and problem 
solving and planning. There was a significant difference 
between classes for TAO requests of information; TAOs on 
superior teams had significantly higher information request 
rates than TAOs on good teams (0.505 & 0.2283 requests/min, 
p = 0.015). One would thus expect subordinate transfers of 
information to the TAO to be lower for subordinates on 
superior teams (the lack of transfers is causing the TAO to 
request more). This expectation did not occur, subordinates 
on superior teams actually had slightly higher transfer 
rates to the TAO than subordinates on good teams, yet the 
TAO was still requesting more information. This seems to 
imply that TAOs on superior teams requested more specific 
types of information than TAOs on good teams (i.e., they 
knew exactly what information was necessary to deal with the 
current situation, possibly, TAOs on good teams did not) . 
There were no significant differences in information request 
rates for the subordinates; subordinates on superior teams 
requested information from their TAOs and subordinates at 
only slightly higher rates. With regards to actions and 
tasks, there were no real differences between TAO request 
rates for superior and good teams. An interesting finding 
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came with subordinate action and task request rates from 
subordinates. Subordinates on good teams had significantly 
higher request rates for A&Ts than subordinates on superior 
teams (0.452 & 0.172 requests/min, p = 0.001). This implies 
that subordinates on good teams were continually sending A&T 
messages to other team members. For example, subordinates 
on good teams had to repeatedly send messages such as "IDS, 
this is AAWC, send a warning to track 1234." If these 
subordinates had followed the TAOs orders at the beginning 
of the scenario, they would have automatically sent warnings 
when contacts approached a range of 25 miles from the ship, 

3 second warning at 15 miles, and a third warning at 10 
miles. Good teams would have had to request (remind others) 
to send warnings on three separate occasions, superior teams 
would have no requests to send out warnings because they 
acted on the TAOs initial orders. 

There were only three other significant findings for 
the combination variables, other than the ones mentioned 
above. There was a significant interaction between class 
and stress for subordinate A&T requests from the TAO (p = 
0.022), a significant interaction between class and period 
for subordinate information request rate from subordinates 
(p - 0.012), and a significant difference across periods for 
subordinate A&T transfers to subordinates (p = 0.014). 
Figure 13 displays the mean A&T rates for subordinates 
across the interaction of class and stress. In this 
interaction, it is interesting to note that in low stress 
conditions, subordinates on good teams had lower request 
rates for A&Ts to their TAOs than subordinates on superior 
teams. What is even more interesting is that subordinates 
on superior teams decrease their request rate to the TAO in 
high stress conditions, while subordinates on good teams 
increase theirs to the point where they have higher request 
rates than superior team subordinates in high stress 



conditions. There are two possible reasons for this. 
First, in high stress conditions, TAOs on superior teams 
might be adapting their strategy to the increased level of 
stress, thus increasing their actions and tasks to meet 
stress demands. 



Second, it is possible that TAOs on superior teams are 
simply sending more A&T transfers to subordinates in high 
stress conditions (i.e., telling them that he has taken an 
action or has performed a task). Subordinates on superior 
teams therefore do not need to send as many A&T requests. 
In fact, TAOs on superior teams do have marginally higher 
A&T transfer rates than TAOs on good teams (0.019 & 0.000 
transfer/min, p = 0.087). Conducting further analysis, the 
two sample t-test confirms that this finding is very close 
to being significant, p = 0.051. Looking to see if TAOs on 
superior teams actually increase these A&Ts transfers during 
high stress conditions, they in fact do, however, this 
finding is not significant. 

Turning to subordinate information request rates from 
subordinates, Figure 14 displays the mean request rates for 
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teams across the three time periods. The significant 
difference between the means across the interaction of class 
and period seems to be the result of the large difference 
between the two classes in period 2. This result is 
opposite of the one expected; we would have expected 
subordinates of superior teams to have lowered their request 
rates in the high paced conditions of period two, hoping 
that their subordinate transfers to subordinates increased. 


Class 

• Superior 
■ Good 


1 2 3 

Period 

Figure 14. Subordinate Information Request Rate 
From Subordinates as a Function of Class and Period 

This would have indicated that subordinates were adapting to 

the high OPTEMPO of period two and were possibly shifting 

their communication strategies from explicit to implicit 

communications. Contrary to expectations, subordinates on 

superior teams actually decreased their transfers in period 

2 (yet still remained higher than their good team 

counterparts). The question of why the requests rates are 

so high still remains. As explained with the TAO, one 

possible suggestion is that subordinates on superior teams 

are just more knowledgeable about the information that is 

necessary to develop a picture of the situation, thus, they 

might have asked for more specific information spread over 

several requests. 


Subordinate Information Request 
Rates From Subordinates 


P = 0.012 
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Shifting attention to Subordinate A&T transfers to 
subordinates, the significant difference between the periods 
seemed to come at period 2 again. Both teams subordinates 
reduced their transfers in this period, actually to the 
point where no transfers where recorded. We would have 
hoped to see subordinates on superior teams increase their 
A&T transfer rates in this busy period, indicating that they 
were telling other members that they had completed an action 
or task. 

6. Anticipation Ratios 

The anticipation ratios are another way to determine 
whether teams are using explicit versus implicit 
communications. There were several significant results in 
the anticipation ratios. These results are described in 
this section. 

a. Transfers vs. Requests 

One particularly important result was based on all 
transfers versus all requests made in a team. Superior 
teams had a marginally higher anticipation ratio than good 
teams (1.97 & 1.65, p = 0.099). This means that over all 
communications, superior teams sent a higher ratio of 
transfers to requests than good teams, indicating more use 
of implicit communications. With regards to the interaction 
of class by period, superior teams had a much higher 
anticipation ratio than good teams in periods 1 and 3 as 
expected (2.39 Vs 0.531 & 1.88 Vs 1.72 respectively, p = 
0.050). This expectation did not hold for period two, good 
teams had a higher ratio of transfers to requests than 
superior teams (1.91 Vs 1.73). In period 2, where the 
OPTEMPO was high, we expected superior teams to transfer 
more messages (which they did), yet they also requested 
more. The unexpected ratio of transfers to requests for 
period 2 is thus deceiving at first. Another significant 
finding was found in the interaction of stress and class, p 
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= 0.03 6. It was assumed that both stresses would have 
increased anticipation ratios as teams traversed across the 
three time periods. This only occurred for low stress 
conditions; teams had anticipation ratios of 1.674, 2.003, 

and 2.289 respectively across the three time periods. Teams 
in high stress conditions had ratios of 2.086, 1.632, and 

1.445. These anticipation ratios actually dropped across 
the time periods and were lower than the low stress ratios 
in periods two and three. We would have hoped that teams 
had high ratios in high versus low stress conditions, 
meaning that they were adapting to the change in stress. To 
see why these results occurred, a deeper look into TAO and 
subordinate anticipation ratios is needed. 

b. Transfer vs Request for TAOs and Subordinates 
Regarding transfers versus requests for the TAO, 
there was a significant difference in the anticipation 
ratios across the interaction of class and period. TAOs on 
superior teams had higher ratios than TAOs on good teams in 
periods 1 and 3 (1.310 vs. 0.531 & 1.525 vs. 1.48 

respectively, p = 0.025). In period 2 again, TAOs on good 
teams had a higher ratio than TAOs on superior teams (1.532 
Vs 1.041). It was expected that TAOs on superior teams 

would have higher ratios in period 2. Inspection of the 
information and A&T anticipation ratios will explain these 
results in the next section. 

Referring to subordinates, subordinates on 
superior teams did have a significantly higher anticipation 
ratio than subordinates on good teams (2.546 Vs 1.915, p = 
0.028). This finding was contrasted by the t- test and is 
discussed later in this chapter. With regards to the 
interaction of stress by period, similar results to that of 
a team's total transfer to request ratio was found. Refer 
to Appendix I to compare these results. Again, subordinates 
increased their ratios across the periods for low stress 
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conditions, yet decreased them in high stress conditions. 
To understand these findings, inspection of TAOs and 
Subordinates transfer Vs request ratios for information and 
A&T is necessary. 

c. Information and Action & Task Ratios 

There is an unexpected finding for TAO information 
transfers Vs requests anticipation ratio; TAOs on good teams 
had a higher ratio than TAOs on superior teams (2.356 Vs 
0.842, p = 0.002). Also, across the interaction of class by 
period, TAOs on good teams had higher ratios in periods 2 
and 3, p = 0.001. This implied that TAOs on good teams had 
a larger ratio of transfers to requests than TAOs on 
superior teams, thus indicating that they were using 
implicit communications while TAOs on superior teams are 
using explicit communications. This result so far is 
unexpected. Digging deeper, there is a reason for this 
unexpected result. In previous sections, it was stated that 
TAOs in both classes had almost identical transfer of 
information rates (0.495 & 0.494 transfers/min). Looking at 
request rates, TAOs on superior teams had significantly more 
information requests than TAOs on good teams (0.505 & 0.228 
requests/min, p = 0.015). Combining these two results, it 
can be easily seen why TAOs on good teams have a higher 
Transfer to Request ratio than TAOs on superior teams; TAOs 
on superior teams had more requests in the denominator of 
the equation and had the same amount of transfers in the 
numerator, which makes their transfer to request ratio 
smaller. It was also stated earlier that they had more 
information requests because they probably knew more 
specific questions to ask about the situation. They didn't 
request more because their subordinates transferred less, in 
fact, their subordinates transferred more (not significant 
though) . Looking at actions and tasks, there was only a 
marginal difference in TAO A&T transfer Vs request ratios 
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between classes, p = 0.093. TAOs on good teams had slightly 
higher ratios, however, it was hard to compare the two 
classes because TAOs on good teams had 0.00 requests for 
A&Ts. 

There was no significant difference between 
superior and good teams for subordinate information 
transfers Vs request to the TAO. We would have liked to see 
subordinates on superior teams have a higher ratio, 
indicating that they were transferring much more than they 
were requesting. Actually, subordinates on superior teams 
had more transfers and requests to the TAO, yet the ratio of 
transfer to requests came out the same. An anticipation 
ratio for A&T transfer Vs request for subordinates to the 
TAO could be computed, however, the ANOVA could not be 
performed due to a rank deficiency in the ANOVA test; the 
column containing the data had many zero values or missing 
data. There is a significant finding across the interaction 
of class and period for subordinate to subordinate 
information transfers Vs request ratio, p = 0.008. The 
interaction graph in Appendix I shows subordinates on good 
teams having a higher anticipation ratio than subordinates 
on superior teams in period 2, thus implying that they might 
be adapting to the high OPTEMPO of period two better than 
superior teams. This finding is deceiving though. Looking 
at the graph for subordinate to subordinate information 
transfers, superior teams, as expected, had high transfer 
rates than good teams. This implied that they were sending 
more information without it having to be prompted by others. 
Having a higher transfer rate, theory suggests that the 
request rates would therefore be lower (i.e., no need to ask 
for information when it is already being transferred without 
request). Despite this theory, superior teams still have 
higher request rates than good teams, possibly suggesting 
again that they know more specific information to request 
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than good teams. Therefore, the reason the anticipation 
ratio is higher in period 2 for good teams is because they 
merely have a higher proportion of transfers to requests, 
even though superior teams have more transfers and more 
requests. 

The only other significant finding came in the 
ratio of team information transfers to the TAO Vs 
information requests of the team from the TAO. Results 
indicate that good teams anticipated their TAOs better than 
superior teams (3.425 Vs 1.695). This finding was the 
opposite of what was expected, however, this was again due 
to the unusual amount of requests by the TAOs on superior 
teams. Again, subordinates on superior teams still 
transferred more than subordinates on good teams, but the 
TAOs also requested more despite more transfers. 

C. TWO SAMPLE T-TEST 

This section focuses on the communication measures that 
were analyzed using Univariate analysis of variance. 
Univariate analysis of variance assumes that the variances 
within the communication measures are equal. The two sample 
t-test need not assume that the variances are equal. It was 
performed on all two level measures to further confirm or 
contradict the initial ANOVA results. The following results 
were found. 

It was stated that superior teams had significantly 
more total communications (utterances) than good team, p = 
0.027. The t-test concluded that there was only a marginal 
difference in total communications between superior and good 
teams, p = 0.068. With regards to lateral communications 
across stress, the t-test concluded that teams had a 
slightly higher significant difference in high versus low 
stress conditions, p = 0.054 as compared to the initial 
finding of p = 0.091. Total TAO requests were also found to 
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have a slightly higher difference between superior and good 
teams, p = 0.055 as compared to initial findings of p = 
0.071. Initial analysis revealed that subordinates on 
superior teams only had a marginally significantly higher 
rate of acknowledgments than subordinates on good teams. It 
was expected that they would have significantly higher 
acknowledgment rates because their TAOs had a significantly 
higher transfer rates. The t-test actually supported this 
expectation, p = 0.054 as compared to p = 0.089, which is 
fairly closer to the expected significant difference. The 
two sample t-test also strengthens the expectations that 
TAOs on superior teams will send significantly higher rates 
of action and task transfers to their subordinates. Initial 
findings revealed a marginally higher transfer rate (p = 
0.087), t-test findings revealed a fairly significant 
difference in the rate of A&T transfers (p = 0.051). 
Subordinate action and task transfers to the TAO across the 
stress conditions revealed that subordinates had 
significantly higher transfer rates in high stress 
conditions, which confirms the expectation that high stress 
conditions cause a team to communicate more than low stress 
conditions. The same applied for subordinate information 
transfer rates to subordinates; they were found to have a 
marginally higher transfer rate in high versus low stress 
conditions, as opposed to no significant difference in 
initial ANOVA analysis. 

D. ANALYSIS OF POST-MISSION DATA 

Analysis revealed that there was no significant 
difference between TAOs and subordinates confidence in each 
other for superior teams. Comparing the confidence levels 
for good teams, the same result applied. Comparing TAOs, 
there was no significant difference between TAOs on superior 
teams and TAOs on good teams when it came to their 
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confidence in the team. When comparing subordinates, 
subordinates on superior teams had significantly more 
confidence in their TAOs than subordinates on good teams 
(6.281 & 5.795, p = 0.042) . 

There were several significant differences across the 
independent variable, stress. Subordinates on superior 
teams felt they were able to anticipate the actions and 
decisions of TAOs significantly more in low versus high 
stress conditions (5.875 & 5.593, p = 0.023). The same 
applies to subordinates on good teams (5.800 & 4.875, p = 
0.046). 

E. ANALYSIS OF WORKLOAD DATA 

Analysis revealed that workload for TAOs on superior 
teams did not significantly differ from workload for TAOs on 
good teams. Looking at the team as a whole (i.e., TAO 
included), superior teams did not significantly differ from 
good teams when it came to workload experienced. There is a 
significant finding for workload experienced by 
subordinates. Subordinates on superior teams experienced a 
higher workload than subordinates on good teams (9.625 & 
8.576, p= 0.054). This finding is interesting because it 
suggests that subordinates on superior teams are 
experiencing a higher workload demand, yet they are still 
communicating and performing their jobs better than 
subordinates on good teams. They are able to adapt to the 
higher workload placed upon them and still sustain better 
performance. 

There was a significant difference between workload 
rating across the stress levels for TAOs, Teams, and 
subordinates. TAOs experienced a significantly higher 
workload in high versus low stress scenarios (13.634 & 
9.361, p = 0.000), teams had a significantly higher workload 
in high versus low stress conditions (10.902 & 8.263, p = 
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0.000), and subordinates teams had significantly higher 
workloads in high versus low stress conditions (10.265 & 
8.048, p = 0.000). This seems to confirm that the levels of 
stress did have an effect on teams perception of the amount 
of work they were doing. 

F. ANALYSIS OF BACKGROUND DATA 

The two items that were analyzed from the background 
questionnaires were team members 1 time at sea and time in 
CIC. These were analyzed to establish whether there was a 
link between time spent on a ship and a team's performance 
ratings in this experiment. The following results were 
expected: TAOs on superior teams would have more time at 
sea, TAOs on superior team would have more time in CIC, and 
Subordinates on superior teams would have more time at sea. 
Looking at Table 4, only the TAOs time in CIC seemed to 
favor superior teams. (further analysis denies this 
confirmation). 



SEA 

Superior Good 

CIC 

Superior Good 

TAOs 

36.25 40.00 

18.25 8.66 

SUBORDINATES 

31.20 52.8 

Missing Data 


Table 4. TAO & Subordinate Time at 


Sea and Time in CIC (Months) 

Inspecting these results even further, there were no 
significant differences between superior and good teams for 
any of the measures; both analysis of variance and the two 
sample t-test suggested that there was not sufficient 
evidence to conclude that the times at sea and times in CIC 
differed significantly between TAOs or subordinates on 
superior and good teams. By general inspection, it would 
appear that TAOs on superior teams had significantly more 
time in CIC than TAOs on good teams (18.25 months compared 
to 8.66 months). Also, it would appear that subordinates on 
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good teams had significantly more time at sea than 
subordinates on superior teams (52.80 months compared to 
31.20 months). Scatter plots were run to inspect why these 
significant differences did not appear. Figure 15 shows 
scatter plots for TAOs time in CIC and subordinates time at 
sea. The middle five teams (classified as very good) were 
added to this plot for the sake of comparison. 



0 10 20 30 40 50 60 

Months In CIC 



0 100 200 300 
Months At Sea 


Figure 15. TAO Time in CIC and 
Subordinate Time at Sea 

The reader will notice that for TAO time at sea, superior, 
very good, and good teams' TAOs had a fairly tight grouping 
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between 0-30 months. There was one TAO on the superior team 
that had much more time in CIC than any other TAOs; this TAO 
was responsible for skewing the average of the superior 
teams' TAOs, thus making it appear that TAOs on superior 
teams had more average time in CIC. Looking at subordinate 
time at sea, subordinates on good teams seem to have much 
more average time at sea than subordinates on superior 
teams. There is one subordinate team in the superior class 
that had almost no time at sea, and this skewed superior 
classes' average to the left. Furthermore, superior teams 
were quite diversified in their average time spent at sea. 
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V 


DISCUSSION 


This chapter reviews the findings presented in Chapter 
IV, RESULTS and attempts to group or summarize the 

characteristics that distinguish superior teams from good 
teams with regards to the TACT experiment. It also 

discusses some of the results in more detail, with a deeper 
look into the differences between teams across the 

independent variable, period. The results are presented in 
the following format; expected results, actual results, 
explanation of results. As a refresher, teams were selected 
for the superior and good classes based on their AAW team 
performance assessments. Once these teams were identified, 
this thesis sought to determine whether superior and good 
teams performed differently across several potential team 

characterizing variables. In addition, it attempted to 
establish whether superior teams use better explicit and 
implicit communication strategies. 

A. DISTINGUISHED CHARACTERISTICS BETWEEN CLASSES 

1. Teamwork Ratings 

Analysis of the teamwork results came out as expected. 

• Expected result : superior teams will have better 
teamwork ratings than good teams. 

• Actual result : superior teams had significantly 
better teamwork ratings than good teams. 

Specifically, superior teams had significantly better team 

orientation (p = 0.000), significantly better communication 

behavior (p = 0.000), significantly better monitoring 

behavior (p = 0.000), significantly better feedback behavior 

(p = 0.011), significantly better backup behavior (p = 

0.011), and significantly better coordination behavior (p = 

0.000). Past studies, such as the one conducted by Stout, 

Cannon-Bowers, Salas, and Morgan (1990), found that teams 
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that had higher performance ratings tended to receive higher 
coordination ratings (Rouse, Cannon-Bowers, and Salas, 1992, 
p.1298). This seems to concur with the findings above. 

2. Communication Variables 

As a refresher, communications were measured in rates, 
specifically, communication per minute. This was calculated 
by tallying the total number of communications in a period 
and dividing this total by the length of the period in 
minutes. Communication rates were identified for both 
classes of teams, superior and good. These rates were also 
identified for members within the classes, specifically, the 
TAO and his subordinates. Team, TAO, and subordinate 
communication rates were further broken down into 
communication requests and communication transfers. 
Requests and transfers were further broken down into 
requests and transfers for information, actions & tasks, and 
problem solving and planning. 

The primary expectation was that superior teams would 
develop better mental models than good teams. For this to 
occur, superior teams should use more implicit communication 
than good teams, implying that they transfer more 
information (without a request for it) and request less 
information than good teams. This leads to the following: 

• Expected results : superior teams should have 
higher communication transfer rates and lower 
communication request rates than good teams. 

• Actual results : superior teams had significantly 

higher transfer rates (p = 0.042), yet almost 

identical request rates. 

Half of the expectation above was confirmed; superior teams 
do indeed have higher transfer rates. This finding would 
indicate that superior teams were anticipating the needs of 
others more than good teams. It was expected that if the 
transfer rates were higher, the request rates would be lower 
(i.e., one does not need to request information if it is 
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already being transferred). To see why superior teams did 
not have lower request rates (despite higher transfer 
rates), analysis of TAO and subordinate communication was 
necessary to see who was doing the transferring and 
requesting. This leads to the following: 

• Expected results : TAOs on superior teams should 
have higher transfer rates to subordinates than 
TAOs on good teams, thus causing lower requests 
rates for subordinates on superior teams. 

• Actual results : TAOs on superior teams have 
significantly higher transfer rates to 
subordinates than TAOs on good teams (p = 0.012). 
Subordinates on superior teams have significantly 
lower request rates than subordinates on good 
teams (p = 0.013}. 

Up until this point, it is established that superior teams 
have higher transfer rates than good teams as expected, and 
their TAOs also have higher transfer rates as expected. The 
results directly above show that subordinates on superior 
teams have significantly lower request rates than 
subordinates on good teams (as expected), yet, the team as a 
whole (TAO + subordinates) does not have lower request 
rates. This leads to the implication that TAOs on superior 
teams must have higher request rates than TAOs on good 
teams, thus keeping the overall team request rate for 
superior teams from being lower than good teams as one would 
expect. Examining this implication, the following is found: 

• Expected results : TAOs on superior teams should 
have lower request rates to subordinates than TAOs 
on good teams. 

• Actual results : TAOs on superior teams have 
marginally significantly higher request rates to 
subordinates than TAOs on good teams (p = 0.055). 

So in fact, it does appear that TAOs on superior teams are 

responsible for keeping the team's average request rate from 

being lower than good teams'. As suggested earlier, TAOs on 

superior teams may be requesting more because they are more 
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aware of the specific information that is necessary to 
create a better picture of the developing scenario. They 
might be searching for answers to the specific information 
by sending out more requests. 

Up to this point, it is suggested that higher TAO 
transfer rates to subordinates on superior teams is 

partially responsible for keeping their subordinates' 
request rates lower than those on good teams. To examine 
whether subordinates also played a role in keeping 

subordinate request rates low, it was necessary to look at 
types of transfers and requests (information, A&Ts, and 
PS&P) . This was also done for the TAO transfers. The 
following was found: 

• Expected results : subordinates and TAOs on 

superior teams should have higher transfer rates 
of information and A&Ts to other subordinates than 
those on good teams. 

• Actual results : There was no significant 

differences between the two classes for 
subordinate transfer rates to subordinates. No 

significant difference between classes for TAO 
information transfer rate to subordinates. A 
marginally significantly higher A&T transfer rate 
to subordinates for TAOs on superior teams. 

• Expected results : subordinates on superior teams 

should have lower information and A&T request 

rates to other subordinates and the TAO than 
subordinates on good teams. 

• Actual results : No significant difference between 

classes for subordinate information request rates 
to other subordinates or the TAO. No significant 
difference between classes for subordinate A&T 
request rate to the TAO. A significantly higher 
A&T request rate to other subordinates on good 

teams (p = 0.001). 

Since subordinates on superior teams had significantly lower 
overall request rates and the only significant finding 

between superior and good teams' subordinates came with 

subordinate A&T request rate from other subordinates, the 
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latter was probably responsible for the significant 
difference in overall request rates for superior teams' 
subordinates. As stated in Chapter IV, RESULTS, this 
finding also suggests that subordinates on good teams were 
constantly reminding other subordinates to take actions and 
perform tasks, even in light of the TAO specifically 
ordering these A&Ts at the beginning of the scenario. 

There were other ways to determine communication 
characteristics of superior and good teams. This was done 
using the anticipation ratios discussed in Chapter IV. With 
regards to the differences between classes, three 
significant findings were revealed. Subordinates on 
superior teams had a significantly higher ratio of transfers 
vs. requests to the TAO than subordinates on good teams 
(71.83% of all messages to the TAO for subordinates on 
superior teams were transfers, compared to 65.67% for 
subordinates on good teams) . TAOs on good teams had 
significantly higher ratios of information transfers vs. 
requests than TAOs on superior teams (70.17% of all 
information messages from the TAO to subordinates on good 
teams were transfers, compared to 45.70% for TAOs on 
superior teams). Finally, Subordinates on good teams 
appeared to anticipate their TAOs better when it came to 
subordinate information transfers vs. TAO information 
requests (3.42 vs. 1.69, p = 0.027). The latter two results 
tend to favor good teams, which was not expected; however, 
possible explanations for these results were provided in the 
anticipation ratio section of Chapter IV. 

3. Post-Mission Data 

Regarding post-mission questionnaire data for superior 
and good teams, the following was found: 
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• Expected results : TAOs on superior teams would 
have more confidence that their subordinates would 
successfully complete the mission. Subordinates 
on superior teams would have more confidence in 
their TAOs. 

• Actual results : No significant difference for 
TAO's confidence between superior and good teams. 
Subordinates on superior teams had more confidence 
in their TAOs than subordinates on good teams. 

Speculating, it is quite possible that this characteristic 

also played a role in helping to reduce overall subordinate 

request rates for superior teams. Generally, if subjects do 

not have a good feeling about their leader's capability to 

lead in crisis situations, they will ask more questions to 

prompt the leader into focusing on the area that the 

subjects feel is being neglected, or, they could be second 

guessing the leader. Looking at this from another view, 

since subordinates on superior teams had significantly more 

confidence in their TAO, they probably felt more comfortable 

during the scenario and trusted the leaders decisions, thus 

requesting less. Turning to the question that asked members 

to assess their ability to anticipate the actions and 

decisions of another, the following was found: 

• Expected results : TAOs on superior teams would be 
able to anticipate the actions and decisions of 
their subordinates better than TAOs on good teams. 
Subordinates on superior teams would be able to 
anticipate their TAOs better than good teams. 

• Actual results : There was no significant 

difference between classes for TAO and subordinate 
abilities to anticipate actions and decisions. 

4. Workload 

With regards to team workload experienced, the 

following was found: 

• Expected results : TAOs and subordinates on 

superior teams will have a higher subjective 
workload than their counterparts on good teams. 
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• Actual results : Only subordinates on superior 
teams felt a significantly higher workload than 
subordinates on good teams. 

For subordinates, this means that overall, they felt; a 
higher mental demand, a higher physical demand, a higher 
temporal demand, possibly lower performance, higher effort, 
and greater frustration. With all these self evaluating 
increases, they still maintained better performance, better 
teamwork ratings, and more confidence in the TAO. 

5. Experience 

Turning to experience, it was expected that TAOs and 
Subordinates on superior teams would have more shipboard 
experience. For this experiment, there was no conclusive 
evidence of these expectations. 

B. DISTINGUISHED CHARACTERISTICS BETWEEN STRESSES 

1. Teamwork Ratings 

Overall, the independent variable of stress tended to 
have a negative effect on a team's teamwork ratings. The 
following was found for high versus low stress conditions: 

• Expected results : Teams will have less orientation 
towards teamwork, lower communication behavior, 
lower monitoring behavior, lower feedback 
behavior, lower backup behavior, and lower 
coordination behavior. 

• Actual results : Teams had marginally significantly 

less orientation towards teamwork (p = 0.055), 

marginally significantly lower communication 
behavior (p = 0.088), marginally significantly 

lower monitoring behavior (p = 0.078), no 

difference in feedback behavior (p = 0.622), no 

difference in backup behavior (p = 0.341), and 

significantly lower coordination behavior (p = 
0.000). 

• Expected results : Superior teams will have less of 
a tendency to stray away from teamwork than good 
teams. 
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• Actual results : Superior teams have less tendency 
to stray away from teamwork in high stress 
conditions. Superior teams drop their teamwork 
ratings from 5.850 to 5.650 in low versus high 
stress conditions, vice 3.367 to 2.100 for good 
teams (rating scale was calibrated from 1 to 7) 

In other studies, under higher stress conditions, it was 

found that subordinates tend to shift their attention 

towards the leader (shift away from lateral communication 

and towards upward communication), become less coordination 

oriented, and become more action oriented (Wang, Luh, 

Serfaty, and Kleinman, 1991, p.2044). It is quite possible 

that the lower backup and lower monitoring behavior for 

teams in high stress conditions in this experiment was a 

result of subordinates shifting their attention towards 

their own tasks. Looking at the communication variable for 

subordinate A&T transfers (i.e., telling another that one 

has completed an action or task), subordinates did indeed 

increase these transfer rates in high stress conditions 

(0.0986 vs. 0.0300 transfers/minute). This finding was not 

significant though, and it cannot positively suggest that 

subordinates were actually becoming more action oriented 

(they might have just increased acknowledgments to others 

that they had completed an action or task) . Concerning 

lateral communication, teams actually increased their 

lateral communication rate in high vs. low stress conditions 

(p = 0.054). Looking at the differences between 

subordinates on superior and good teams, subordinates on 

superior teams increased their lateral communication rate by 

39.8% in high stress conditions, subordinates on good teams 

increased theirs by 8%. Shifting to upward communication to 

the TAO, subordinates on superior teams increased their 

upward communication rate in high stress conditions by 3.5%, 

subordinates on good teams increased theirs by 58%. These 

findings were not significant; however, the pattern seems to 
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suggest that subordinates on superior teams turn towards 
each other during high stress conditions (avoiding the 
tendency to turn to the TAO) while subordinates on good 
teams turn towards the TAO (leader). 

2. Communication Variables 

Regarding the effects of stress on other communication 
variables for teams, the following was found: 

• Expected results : Teams will increase their 

request and transfer rates in high versus low 

stress conditions. This expectation applies to 
TAOs and subordinates also. 

• Actual results : Teams significantly increase their 

request and transfer rates in high versus low 

stress conditions (p = 0.002 & 0.003 

respectively). TAOs significantly increase their 
request rates (p = 0.013) and marginally 

significantly increase their transfer rates (p = 
0.088). Subordinates significantly increase their 
request rates (p = 0.011) and significantly 

increase their transfer rates (p = 0.005). 

The findings above were probably due to the greater number 

of contacts on the screen in high versus low stress 

conditions. There were some other expectations when it came 

to request and transfer rates for superior and good teams 

between classes: 

• Expected results : Superior teams would have a 
larger increase in transfer rates and a lower 
increase in requests rates than good teams in high 
versus low stress conditions (implying that 
superior teams were adapting to stress and 
anticipating one another better) 

• Actual results : There were no significant 

differences between teams' requests and transfer 
rates in high versus low stress conditions. 

Although the results were not found to be significant, 

superior teams did increase their transfer rates from low to 

high stress conditions by 34.8%, as opposed to 23% for good 

teams. Also, superior teams increased their request rates 

from low to high stress conditions by 41%, as opposed to 57% 


for good teams. Evaluating these results for TAOs and 
subordinates on superior and good teams, the following was 
found: 

• Expected results : TAOs and subordinates on 

superior teams would have a larger increase in 
transfer rates and a lower increase in request 
rates than their good team counterparts in high 
versus low stress conditions. 

• Actual results : There were no significant 

differences for TAO and subordinate's request and 
transfers rates in high versus low stress. 

Although these results were not found to be significant, the 

following patterns did emerge: TAOs on superior teams 

increased their transfer rates from low to high stress by 

39%, as opposed to 29% for TAOs on good teams; TAOs on 

superior teams increased their request rates by 60%, as 

opposed to 98% for TAOs on good teams; subordinates on 

superior teams increased their transfers by 33%, as opposed 

to 21% for subordinates on good teams; and subordinates on 

superior teams increased their requests rates by 24%, as 

opposed to 40% for subordinates on good teams. Summing the 

results above, as expected, TAOs and subordinates on 

superior teams did have higher transfer rates than their 

counterparts on good teams in high versus low stress 

conditions. They did not have lower request rates as was 

expected; however, their percentage increase in requests 

going from low to high stress was lower than that of good 

teams. This suggests that TAOs and subordinates on superior 

teams might have been adapting their communication strategy 

to meet the high stress demands. Despite the patterns 

above, there was no significant evidence to suggest that 

superior teams shifted from explicit to implicit 

communication more than good teams across the two stress 

conditions. 
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3. Post-Mission Data 

It was found that stress had the following effects on 
teams’ post mission questionnaires: 

• Expected results : TAOs and subordinates will have 
lower anticipation skills in high versus low 
stress conditions. 

• Actual results : Subordinates on both superior and 
good teams felt they were able to anticipate the 
actions and decisions of the TAO better in low 
versus high stress conditions. 

It is apparent that the increase in stress changed a 
subordinate's perception of how well they were able to 
anticipate the TAO. There were no significant interactions 
between class and stress. 

4. Workload 

With regards to workload; teams, TAOs, and subordinates 
all felt a stronger workload in high stress conditions. 
High stress conditions tended to increase mental and 
physical demands, along with the amount frustration and 
effort put forth. There were no significant differences 
between superior and good teams' workloads between stresses. 

C. DISTINGUISHED CHARACTERISTICS BETWEEN PERIODS 

The purpose of analyzing differences between periods 
was to investigate how teams react to stresses that are 
building within a scenario; ALPHATECH calls these interior 
stresses, "micro-bursts" of stress. As a refresher, period 
1 was considered to be low input workload, period 2 had 
increasing input workload, and period 3 had high and 
sustained input workload. There were some significant 
differences between periods and a significant interaction 
between class and period. 

The first finding came with lateral communication 
between subordinates. The following results were found: 
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• Expected results : Teams will increase their 

lateral communication rate across the three time 
periods. 

• Actual results : Teams decreased their lateral 
communication rate across the three time periods. 

The expected results above are considered from an 

operational standpoint. One would expect that teams would 

try to communicate more laterally in order to adjust to the 

increasing OPTEMPO. The actual results are found in other 

studies, specifically, Wang, Luh, Serfaty, and Klienman. 

Referring to Appendix H, main effects plot for lateral 

communications, the reader can see this decrease in 

communication rates across the three time periods. With 

this decrease in lateral communication, one would expect 

that teams would shift to more upward communication, in 

fact, they do. Figure 16 shows this increase in upward 

communication. 



Figure 16. Upward Communication Rate 


Looking closely, teams actually increase their communication 
with the TAO from period 1 to period 2, where the change in 
OPTEMPO is large. Inspecting this further, the decrease 
from period 2 to period 3 is actually due to good teams. 
Figure 17 shows this change. Superior teams actually kept a 
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steady increase across the three periods (1.410, 1.459, & 
1.494 comms /minute respectively). Good teams had (1.060, 
1.305, & 1.160 comms/minute respectively). 


C lass 

• Superior 
■ Good 


1 2 3 

Period 


Figure 17. Upward Communication Rate 
as a Function of Class and Period 

The initial expectation was that teams in general would 

increase their upward communication rate across the three 

time periods; it was found that only superior teams do this. 

Another finding came with outward communication; The 

following results were found: 

• Expected results : TAOs will increase their outward 
communication rate across the three time periods. 

• Actual results : TAOs increased their outward 
communication rate across the three time periods 

(p = 0.018). 

Just as with lateral communication, TAOs on superior teams 
steadily increased their communication rate across the three 
time periods, TAOs on good teams actually decreased their 
communication rate in period 3. Figure 18 shows this 
pattern. A possible reason for the rate of change between 
classes in period 3 is that TAOs on superior teams probably 
recognized the importance of keeping their commander 
informed, and when time permitted at the end of the 


Upward Communication Rate 
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scenario, they probably felt obliged to keep their commander 
abreast of the events that unfolded. 



Figure 18. Outward Communication Rate 
as a Function of Class and Period 

Regarding TAO transfers, the following results were found: 

• Expected results : TAOs will increase their 

transfer rates across the three time periods. 

• Actual results : TAOs increased their transfer 
rates across the three time periods. 

It was expected that as the stress built within the scenario 

(i.e., across the three time periods) TAOs would adapt to 

this increasing stress by sending more transfers to other 

members. Digging deeper, TAOs on superior teams steadily 

increased the rate of transfer across the three time periods 

(0.066, 1.229, & 1.513 transfers/minute respectively). TAOs 

on good teams increased their transfer rate in period 2, yet 

again, decreased this rate in period 3 (0.393, 1.000, & 

0.943 transfers/minute). Figure 19 shows this pattern. 

Regarding the results that were just mentioned above, the 

pattern seems to be that TAOs on good teams tend to slow 


their communication rate in period 3 while TAOs on superior 
teams continue to keep up the pace until the scenario 


actually ends. 
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Figure 19. TAO Transfer Rate as a 
Function of Class and Period 

There was an interesting occurrence that appeared in the 
interaction of class and period for subordinate information 
request rate from subordinates. The following results were 
found: 

• Expected results : Subordinates on superior teams 
would have lower information request rates across 
the three time periods than subordinates on good 
teams. 

• Actual results : Subordinates on superior teams had 
lower information request rates in periods 1 & 3, 
but higher request rates in period 2. 

Figure 14, RESULTS, section 5, shows the interaction of 

class by period for subordinate information request rate 

form subordinates. In period 2, subordinates on superior 

teams increased their request rates while subordinates on 

good teams decreased theirs. This occurrence might suggest 

that subordinates on superior teams in period 2 had lower 

transfers to other subordinates, and subordinates on good 

teams in period 2 would have higher transfers to other 

subordinates. Part of this statement is true; subordinates 

on superior team do actually decrease their transfers in 

period 2, yet, so do subordinates on good teams. 
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Subordinates on superior teams actually have higher transfer 
rates than subordinates on good teams in each of the three 
time periods. The implication here is, subordinates on 
superior teams have higher request rates in period 2 because 
they are probably requesting more specific types of 
information that will help them better assess the unfolding 
events in this high OPTEMPO period. They might be 
anticipating required information better than subordinates 
on good teams, despite more transfers to them. 

Delving into the anticipation ratios, there is a 
significant difference between teams' transfers vs. requests 
(p = 0.050). This appears to be due to the difference in 
period 1 between classes. Superior teams tend to have a 
higher proportion of transfers to requests in this period. 
Another finding is, TAOs tend to increase the proportion of 
transfers to requests across the three time periods (p = 
0.043). Looking at the differences between TAOs in the 
classes across the three time periods (p = 0.025), TAOs on 
superior teams have higher proportions of transfers to 
requests in periods 1 & 3, yet have lower proportions in 
period 2. The results for period 2 are unexpected, it was 
expected that TAOs on good teams would have a higher 
proportion of transfers to requests in period 2 since this 
is the period where most of the action takes place. 
Explanations for this occurrence is provide in Chapter IV. 
Shifting to a more specific anticipation ratio, there is a 
significant difference in the interaction of class and 
period for TAO information transfers vs. requests (p = 
0.001). For the most part, TAOs on good teams have higher 
proportions of information transfers vs. requests in periods 
2 & 3. TAOs on superior teams actually decrease this 
proportion going from period 1 to period 2. These results 
were also unexpected. Shifting to subordinates, 
subordinates do tend to produce expected results. 
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Subordinates on superior teams do have higher proportions of 
transfers to requests than subordinates on good teams (p = 
0.026). These higher proportions are found in periods 2 & 
3, where the OPTEMPO is high. This finding suggests that 
subordinates on superior teams might be using more implicit 
communication than subordinates on good teams in period 2 & 
3 (where it counts the most). The final finding came in the 
anticipation ratio for subordinate information transfers to 
the TAO vs. information requests from the TAO. Subordinates 
on superior teams tended to anticipate their TAOs less in 
periods 2 & 3 and slightly more in period 1 than 
subordinates on good teams. These results were unexpected 
and were explained in the results section. The main reason 
for the unexpected results was that TAOs on superior teams 
tended to request more, regardless of how much was 
transferred to them. This heightened request rate caused 
the anticipation ratios to be lower for superior teams and 
weakens the argument that good teams anticipated their TAOs 
more. 

D. CONCLUSION 

One of the primary goals of this thesis was to 
investigate whether superior teams used more implicit 
communication - leading towards the development of mental 
models - more than good teams. It was shown that superior 
teams do indeed send messages in the form of transfers more 
than good teams, yet they also send more requests. This 
heightened amount of requests by superior teams (which was 
unexpected at first) rendered the anticipation ratio 
measurement of a teams ability to anticipate one another to 
be less effective. Furthermore, it was expected that this 
increase in the amount of requests was due to superior teams 
asking for more specific information that was spread out 
over several requests. It was suggested that superior teams 
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tried to take in more specific information that they felt 
would help them assess the situation better. Good teams 
might have had more broad or general requests that gave them 
only part of the picture. 

It was found that superior teams had significantly 
better teamwork ratings, felt significantly more workload 
(yet performed better), and had significantly more 
confidence in their TAOs. It was found that stress also had 
an effect on teams. In most cases, teamwork ratings dropped 
and the amount of workload increased. Across stress, 
superior teams still had better teamwork ratings than good 
teams in both low and high stress conditions. Both classes 
felt that they were able to anticipate their TAOs better in 
low versus high stress conditions. 

Regarding stress within each scenario, for the most 
part, superior teams had better communication use. Superior 
teams tended to adapt to the increasing OPTEMPO as stress 
built within the scenario. Even in times where good teams 
had more transfers or requests, superior teams seemed to 
overtake good teams when the OPTEMPO shifted to a higher 
pace. 
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VI. RECOMMENDATIONS 


This chapter provides recommendations for the 
enhancement of the TACT experiment and gives suggestions for 
improving team training within Navy CIC teams. 

A. ENHANCEMENTS TO THE TACT EXPERIMENT 

For the most part, the TACT experiment proved a useful 
tool for measuring team performance and communication skills 
within a team. It was stated earlier that the anticipation 
ratio measurement of a team's ability to anticipate one 
another seemed to be skewed by the unexpected amount of 
requests that superior teams generated. This high request 
rate tended to lower the anticipation measurement of 
superior teams. It was also shown that superior teams did 
not request more due to less transfers; it was speculated 
that they requested more specific types of information that 
allowed them to generate a better or more complete picture 
of the unfolding events. This was only a speculation, there 
was no way to tell if they actually were requesting more 
specific information. It is recommended that some type of 
measure be devised to determine when teams are requesting 
more enhancing information. Placing a "value" or 
"importance factor" on the communication message itself 
(i.e., information, A&Ts, and PS&P) may lend insight to this 
problem. Teams may have the same request and transfer 
rates, but did one team request or transfer messages that 
were more vital to the accomplishment of the teams goal? As 
an example, a TAO on team (A) asks the IDS what he has on a 
bearing of 245 degrees. The IDS replies, "It looks like an 
unknown contact." A TAO on team (B) asks the same question. 
The IDS replies, "It is a lower flyer, altitude appears to 
be 1000 feet, the speed is approximately mach 1.2, there is 
no IFF signature, and it has not responded to any 
interrogation messages." The IDS on team (B) supplied much 
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more vital information and the team member, or team, should 
be rewarded for this information flow. 

Another area where the tact experiment could be 
enhanced is in the generation of stress between low and high 
stress scenarios. It is recommended that for high stress 
conditions, target profiles should be manipulated more. 
Contacts should have higher speeds, lower altitudes, and 
more threatening flight paths than low stress scenarios. 
Adding more contacts to the screen definitely creates more 
stress when individuals have to try to identify them, the 
above recommendation should create an extra level of stress 
that could be used to further separate the two stress 
conditions. 

B. ENHANCEMENTS TO NAVY TRAINING 

From experience, CIC teams on Navy ships are mainly 
taught how to detect threatening contacts and the methods 
used to thwart them. Subordinates are told to identify 
these contacts, gain as much information from them as 
possible, and forward this to other subordinates and the 
TAO. Regarding communications, there is one main phrase 
that has probably been heard by every member that has ever 
participated in a CIC team, "Do not clutter the 
communication network with unnecessary chatter." This is 
about the extent of communication strategy training. 
Although the above statements are very important, it is 
recommended that CIC teams be taught communication 
strategies that will enhance overall team performance. 
Separate training should be conducted to teach team members; 
how to communicate, when to communicate, what type of 
communication is important, how and why feedback and backup 
to others should be conducted, how stress effects a team's 
performance and how to deal or adapt to it, and how to 
concentrate on anticipating the needs of others. Many 
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studies have been conducted that have recognized the 
important characteristics that make up successful teams; 
Navy teams should have access to this information and should 
be taught how to develop or improve these characteristics 
(separate from the standard CIC team trainer that 
concentrates of target engagement). 


93 




94 



APPENDIX A 


OBSERVATION FORMS AND QUESTIONNAIRES 


and 

TACT 


This Appendix contains the observation forms 
questionnaires that were used to collect data in the 
experiment. 
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TACT EXPERIMENT (TADMUS) 

TEAMWORK AND PEREORMANCE: OBSERVER’S RATING FORM 

TEAM #_ SITE_ DATE_ OBSERVER_ SCEN #_ 


Instructions for Teamwork Ratings 

Circle a number on the scale accompanying the questions on the following pages so that it best 
describes the behavior of the team you just observed. Consider each team separately. Try not to 
compare one team to another. Instead strive to rate the behavior of a team on an absolute scale. To help 
you perform this absolute rating a brief description of the behavior you should observe for the highest 
rating on the scale and a brief description of the behavior you should observe for the lowest rating on the 
scale are provided for each question. Read these guides or anchors carefully and refer to them as you 
rate the team on each item. Feel free to write comments or explanations for any question. 

The rating scales or questions for teamwork are organized into six areas. To further help you in your 
ratings each area is defined below. Please read these dennitions carefully. 


Team Orientation 

Team orientation refers to the commitment team members have and exhibit to working together. It 
implies that they place the goals and interest of the team ahead of their personal goals. It also refers to 
the trust each team member has in the other team members, team pride, and esprit de corps. 

Communication Behavior 

Communication involves the exchange of information between two or more team members in the 
prescribed manner and by using proper terminology. Often the purpose of communication is to clarify 
or acknowledge the receipt of information. 

Monitoring Behavior 

Monitoring refers to observing the activities and performance of other team members. It implies that 
team members are individually competent and that they may subsequently provide feedback and backup 
behavior. 

Feedback Behavior 

Feedback involves the giving, seeking, and receiving of information among members. Giving 
feedback refers to providing information regarding other member's performance. Seeking feedback 
refers to requesting input or guidance regarding performance. Receiving feedback refers to accepting 
positive and negative information regarding performance. 

Back-up Behavior 

Backup behavior involves assisting the performance of other team members. This implies that team 
members have an understanding of other member's tasks. It also implies that members are willing to 
give and seek assistance. 

Coordination Behavior 

Coordination refers to team members' executing their activities in a timely and integrated manner. It 
implies that the performance of some team members influence the performance of other team members. 
This may involve an exchange of information that subsequently influences another member's 
performance. 
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Team Orientation 

1. To what extent was this team oriented toward teamwork? 

1 I 2 H 3 I 4 I 5 1 6 I 7 

7 Good team orientation could be inferred in a situation where a team member places the goals and interests of the 
team ahead of personal goals. Also may be evident through the display of trust, team pride, and esprit de corps, and an 
awareness that teamwork is important. 

1 Poor team orientation manifests itself when members place their personal concerns above the team's success fe.g., 
disregarding or refusing to follow procedures; arguments, quarrels, and open resentment; and becoming upset with a 
member’s performance and either ignoring or harassing that member are evidences of poor team orientation). 

2. To what extent were errors caused by inadequate team communication? 


7 Communication within the team was always effective and never responsible for errors or degraded performance. 
1 Communication was wholly inadequate and resulted in most of the errors made by the team. 

3. To what extent were errors caused by improper individual actions or decisions? 


7 No actions or decisions of a single team member resulted in errors or poor team performance. 

1 The actions and/or decisions by a single team member very frequently resulted in errors or poor team performance. 


Comments:_ _ _ 

Communication Behavior 

4. How well did team members communicate? 


7 Good communication occurs when team members pass on ail important information and clarify intentions and 
planned procedures; members obtain necessary information and acknowledge and repeat messages to ensure 
correctness; members ensure that their messages are received as intended. 

1 Poor communication occurs when team members fail to pass on information or intentions, or pass on incomplete 
communications; members fail to clarify information; members fail to acknowledge other member's requests or reports; 
members disregard proper security procedures for communication; members use improper terminology; members tie up 
the net with irrelevant communications. 
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5. To what extent did the TAO provide tactical direction or relevant information to other team 
members, without the other team members having to ask for it? 

1 i 2 i 3 i J i 5 i 6 i 7 

7 TAO always provided important direction or information to other team members without being asked, 
l TAO never provided direction or information to other team members unless specifically asked, 

6. To what extent did other team members provide relevant tactical information to the TAO, without 
the TAO having to ask for it? 



7 Other team members always provided important information to the TAO without being asked. 
1 Other team members never provided information to the TAO unless specifically asked. 

Comments:,___ 

Monitoring Behavior 

7. To what extent did team members monitor each other’s behavior? 



7 Good monitoring occurs when team members consistently observe the performance of the others to ensure the 
efficiency of the team; members notice and are concerned with the performance of the entire team; one member 
recognizes when other team members perform correctly; members consistently keep track of other team members’ 
performance. 

I Poor monitoring occurs when team members fail to notice other team members' performance on almost all 
occasions; members rarely notice when other team members perform correctly or make a mistake. 

8. To what extent did team members alert each other to impending decisions and actions? 



7 Team members always alerted each other to impending decisions and actions; supporting information was actively 
solicited from other team members. 

1 Team members did not keep each other informed of impending decisions and actions; compromises to mission 
safety or mission effectiveness arose when a team member waited for the other to volunteer significant information. 

Comments:_ 
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Feedback Behavior 

9. To what extent did team members provide feedback to one another? 


7 Good feedback behavior occurs when team members go over procedures with one another by identifvin^ mistakes 
and how to correct them; members ask for input regarding mistakes and what needs to be worked on; members are 
corrected for mistakes and incorporate the suggestions in their procedures. 

i Poor feedback behavior occurs when one or more team members makes sarcastic comments to one or more members 
when the scenario doesn't go as planned; members resist asking for advice and make guesses on proper procedures; 
members reject time-saving suggestions offered by other team members. 


Comments:_ 

Backup Behavior 

10. To what extent did team members provided backup to one another? 


7 Good backup behavior occurs when one team member is having difficulty, makes a mistake, or is unable to oerform 
dudes, and one or more members steps in to help, ensuring that the activity is completed properly; one or more 
members provide critical assistance without neglecting their own assigned duties; the member having difficultv or 
overburdened displays a willingness to seek assistance rather than struggle and make a mistake. 

1 Poor backup behavior occurs when one or more members fail to provide assistance to another member who is 
having difficulty, makes a mistake, or is unable to perform his duties; while providing assistance, the members tends to 
neglect their own dudes; members are unwilling to ask for help even when it is available; one member provides needed 
assistance, but does not inform others that he is occupied assisting another or what he has done; one member displays an 
unwillingness to help others even when asked. 

11. To what extent did the TAO anticipate the need to provide (some) assistance to one or more team 
members? 


7 TAO consistently anticipated the need to provide assistance to other team members during critical phases of the 
mission. 

1 TAO never anticipated the need to provide assistance to other team members during critical chases of the mission; 
the other team members always had to ask. 

12. To what extend did the other team members anticipate the need to provide assistance to the TAO? 


7 Other team members consistently anticipated the need to provide assistance to the TAO during critical phases of the 
mission. 

1 Other team members never anticipated the need to provide assistance to the TAO during critical phases of the 
mission; the TAO always had to ask. 
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13. Did the team members adjust individual task responsibilities to prevent overload? 


7 Team members were consistently aware of each other's workload buildup and reacted quickly to adjust division of 
task responsibilities to redistribute workload . 

[ Team members were generally unaware of each other's workload buildup; little or no attempt was made to adi-ist the 
distribution of task responsibilities before significant compromises to mission safety or mission effectiveness occurred. 


Comments: 


Coordination Behavior 

14. To what extent was the team's behavior coordinated? 


7 Good coordination behavior occurs when team members consistently pass critical information to the other members, 
thereby enabling them to accomplish tasks; members consistently carry out tasks quickly or in a timeiv manner enabling 
others'to carrv out their tasks effectively. Team members appear very familiar with the relevant parts of one another's 
jobs and carry out individual tasks in a synchronized manner. 

I Poor coordination behavior occurs when team members consistently carry out their tasks ineffectively, leading to 
other team members' failing at their tasks; members carry out their tasks unpredictably, leading to delays in execution of 
critical tasks; members neslect to pass on critical pieces of information to one another, leading to breakdowns in team 
performance; team members carry out their tasks with signif cant delays leading to team errors. 

15. How congruent/similar were the TAO’s and the other team members’ understanding of the mission? 


7 TAO and other team members were completely in agreement (i.e., congruent) on goals, tasks, and concepts 
involving the mission. 

1 TAO and other team members were rarely in agreement (i.e., congruent) on goals, tasks, and concepts involving the 
mission. 


Comments: 
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OVERALL AAW TEAM PERFORMANCE ASSESSMENT 
Instructions for Performance Ratings 

Please assess the performance of the team for the following tasks and/or activities using the 
scales provided. Note that a score of 7 always denotes effective or superior performance, while a score 
of 1 always denotes ineffective or very poor performance. The anchors or descriptors associated with 
the high and low scores are what you should expect to see for very effective and very ineffective team 
performances, respectively. They are provided as guidance for your ratings. 

1. Making radar detection reports . This refers to the report made by any team member who verbally 
describes the radar contact. 

Very Poor 12 3 4 5 6 7 Superior 

7 Tne radar detection reports are always accurate, concise, and timely. Proper format (e.g., APP-1, NWP-32) and 
terminology are always used. 

1 Some radar detections are never reported. Many reports are inaccurate and late. Often proper format and terminology are 
not used. 

2. Making ESM detection reports . This refers to verbal reports of ESM detections. 

Very Poor 1 2 3 4 5 6 7 Superior 

7 Tne ESM detection repons are always accurate, concise, and timely. Proper format and terminology are always used. 

1 Some ESM detections are never reported. Many reports are inaccurate and late. Often proper format and terminology are 
not used. 


3. Tdentification/Correlation reports . This refers to verbal reports of the correlation and identification of 
contacts. 


Very Poor 1 2 3 4 5.6 7 Superior 

7 The ID/Correlation reports are always accurate, concise, and timely. Proper format and terminology are always used. 

1 Some ID/Correlations are never made and/or reported. Many reports contain errors and/or are late. Frequently improper 
format and incorrect terminology are used. 

4. Assessment of contacts' hostile intent . This is typically based on input from lower levels within the 
team and made by the TAO or CO. 

Very Poor 1 2 3 4 5 6 7 Superior 

7 TAO/CO routinely assess the threat of each new contact and advise the rest of the team accordingly. Assessment is 
firmly based on information the team has collected (e.g., ESM, ID/Corr, Intel) and on verbal discussions concerned with 
weapons loads, flight profiles, and attempts at communication with the contact. 

1 TAO/CO infrequently assess the threat of new contacts and/or rarely advise the rest of the team as to the contact's threat. 
Assessment is often not based on available information and verbal discussion about such aspects as weapons load and flight 
profile have not occurred. 
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5. Monitoring the threat . This pertains primarily to critical contacts of interest (CCOI). 

Very Poor 1 2 3 4 5 6 7 Superior 

7 CCOIs are frequently hooked and observation of them are more or less constant. Tne status of the CCOIs are frequently 
discussed and appraised - in short the intensity of involvement with these threats is high. 

1 CCOIs are frequently neglected or overlooked. The status of CCPIs are not reviewed, discussed, or appraised frequently 
enough - in short, the intensity of involvement with these threats is low. 

6. Taking appropriate action in accordance with ROE . This refers to whether the team decides to take 
some action against a given CCOI vs. failure to do anything about it. 

Very Poor 1 2 3 4 5 6 7 Superior 

7 TAO (or CO) and team consistently take effective and appropriate actions to deal with threats. This includes assigning 
CAP, covering, issuing verbal warnings, increasing readiness/going to GQ. activating doctrine, and determining chart 
solutions. 

1 TAO (or CO) and team are lax and often fail to take effective or appropriate actions to deal with threats. They tend to 
over react or fails to react. 

7. Planning for the upcoming mission. This refers to all planning activities performed by the TAO or 
other team members for the upcoming mission. 

Very Poor 12 3 4 5 6 7 Superior 

7 The TAO and/or other team members spend a reasonable amount of ume planning for the upcoming mission. Roles are 
further defined and tasks that are outside normal responsibility assigned. Critical events that might occur are cleariv defined 
and specific responses agreed upon. 

1 The TAO and/or other team members spend little or no time planning for the upcoming mission. Roles are not further 
defined and tasks that are outside normal responsibility are not assigned. Little or no discussion occurs about critical events 
that might occur. Those events that are mentioned are not defined well nor are responses to the events delineated. 

8. Overall performance rating of this team fo r this scenario. 

Very Poor 1 2 3 4 5 6 7 Superior 

7 Superior teams have consistently scored well on the above six areas, as well as on other unassessed areas. 

1 Poor teams have consistently scored poorly on the above six areas, as well as on other unassessed areas. 
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9- Performance of critical events. Below are four critical events that occurred in this scenario 
Rate how the team performed each on the seven point scales provided. 

a. Four Iranian F4s detected . 

Very Poor 1 2 3 4 5 6 7 Superior 

b. Iranian bogies split into two sections. 

Very Poor l 2 j 4 5 6 7 Superior 

c. APQ120 detected (Iranian F4). 

Very Poor 12 3 4 5 6 7 Superior 

d. Low F4s pop-up at 46nm. 

Very Poor 1 2 3 4 5 6 7 Superior 
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TACT EXPERIMENT (TADMUS) 

CIC TEAM PRE-MISSION QUESTIONNAIRE 

TEAM#_ SITE_ DATE_ TEAM POSITION_ SCEN#_ 

1. How much confidence do you place in the ability of the other members of your team to accomplish 
this mission? 

Very Little 1 2 3 4 5 6 7 A Great Deal 

2. How much confidence do you think the other team members place in your ability to accomplish this 
mission? 

Very Little l 2 3 4 5 6 7 A Great Deal 

3. To what extent should team members be aware of other team members workload? 

Very Little l 2 3 4 5 6 7 A Great Deal 

4. To what extent do highly competent team members experience stress? 

Very Little 1 2 3 4 5 6 7 A Great Deal 

5. A team member's decision making ability is as good in stressful situations as it is in non- stressful 
conditions. 

Strongly Disagree 1 2 3 4 5 6 7 Strongly Agree 

6. Monitoring the TAO's performance for possible mistakes and errors tends to reduce the TAO's 
stature and authority. 

Strongly Disagree 1 2 3 4 5 6 7 Strongly Agree 

7. A team member should offer task help to another team member only if he/she is being asked to do 
so. 

Strongly Disagree 1 2 3 4 5 6 7 Strongly Agree 

8. To what extent should team members monitor other team members for signs of stress? 

Very Little 1 2 3 4 5 6 7 A Great Deal 

9. To what extent should team members mention/share their own feelings of stress/workload with other 
team members during a mission? 

Very Little l 2 3 4 5 6 7 A Great Deal 
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10. Even when stressed, I perform effectively during critical aspects of the mission. 

Strongly Disagree 12 3 4 5 6 7 Strongly Agree 

11. To what extent should team members change their work strategy in response to high 
stress/workload? 

Very Little 1 2 3 4 5 6 7 A Great Deal 

12. Communications among team members are rarely affected by high stress/high workload. 

Strongly Disagree 1 2 3 4 5 6 7 Strongly Agree 

13. To what extent should team members take account of other team members' personalities for effective 
crew coordination? 

Very Little 1 2 3 4 5 6 7 A Great Deal 

14. To what extent can the effectiveness of crew coordination be lowered by stress/workload? 

Very Little 1 2 3 - 5 6 7 A Great Deal 

15. It is not a good idea to point out an error committed by a team member during a mission. 

Strongly Disagree l 2 3.4 5 6 7 Strongly Agree 

16. To what extent are reprimands more effective than discussions in eliminating some elements of a 
team member’s poor task performance? 

Very Little 1 2 3 4 5 6 7 A Great Deal 

17. To what extent is understanding the TAO's concepts and beliefs about the mission important to a 
team member's execution of the mission? 

Very Little 1 2 3 4 5 6 7 A Great Deal 

18. Task overload usually occurs because a team member is not very competent. 

Strongly Disagree 1 2 3 4 5 6 7 Strongly Agree 

19. Each team member should watch for situations in which external events hinder the performance of 
other team members. 

Strongly Disagree 1 2 3 4 5 6 7 Strongly Agree 

20. Team members should be able to anticipate each other’s information needs during the mission. 

Strongly Disagree 1 2 3 4 5 6 7 Strongly Agree 
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TACT EXPERIMENT (TADMUS) 

CIC TEAM POST-MISSION QUESTIONNAIRE 


TEAM#_ SITE_ DATE_ TEAM POSITION_ SCEN#_ 

1. How much confidence did you have during the mission that the TAO would successfully complete 
the mission ? 



Very Little Moderate A Great Deal 

2. How much confidence did you have during the mission that the other team members would 
successfully complete the mission? 



Very Little Moderate A Great Deal 

3. How much assistance did you provide to other team members as the mission unfolded? 



Very Little Moderate A Great Deal 

4. To what extent did you cross-monitor the actions of other team member as the mission unfolded?- 



Very Little Moderate A Great Deal 

5. To what extent were you able to anticipate (i.e., predict) the actions and decisions of the TAO? 



Rarely Half The Time All The Time 

6. To what extent were you able to anticipate (i.e., predict) the actions and decisions of the other team 
members? 



Rarely Half The Time All The Time 
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7a. What was the most critical episode of this mission? 


b. During this episode to what extent were you thinking and acting “in sync” with the TAO? 



Very Little ’ Moderate 


A Great Deal 


c. How do you know that? 


d. During this episode to what extent were you thinking and acting i4 in sync” with other team 
members? 


ti2|3|4|5i6|7 


Very Little 

e. How do vou know that? 


Moderate 


A Great Deal 


Put an "X M on each of the six scales below, at the point that matches best your workload 
experience for the mission you have just accomplished. 


Mental Demand 


Physical Demand 


Verv Low 


Very High 


Very Low 


Very High 


Temporal Demand 
(Time Pressure) Very Low 


Very High 


Performance 


Effort 


Frustration 


Perfect 


Failure 


Very Low 


Very High 


Very Low 


Very High 
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TEA A #_ 

PERIOD l 2 3 


TACT EXPERIMENT (TADMUS) 

CIC TEAM COMMUNICATION RECORDING FORM: TAO 
_ SITE DATE OBSERVER SCEN #_ 


TYPE & CONTENT 


INFOR¬ 

MATION 

REQUESTS 

ACTION 
& TASK 


PROBLEM 
SOLVING & 
PLANNING 

TRANSFERS 

INFOR¬ 

MATION 

ACTION 
& TASK 


PROBLEM 
SOLVING & 
PLANNING 

ACKNOWLEDGMENTS 


TAO to: 
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TACT EXPERIMENT (TADMUS) 

CIC TEAM COMMUNICATION RECORDING FORM: Team 


TEAM #_ 

PERIOD 1 2 3 


SITE 


DATE 


OBSERVER. 


SCEN# 


TYPE & CONTENT 

REQUESTS 

INFOR¬ 

MATION 

ACTION 
& TASK 


PROBLEM 
SOLVING & 
PLANNING 


INFOR¬ 

MATION 

TRANSFERS 

ACTION 
& TASK 


PROBLEM 
SOLVING & 
PLANNING 

ACKNOWLEDGMENTS 


TIC to: | IPS to: |AAWCto:| EWSto: |Teamto: 



Additional notes / Other categories: 
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TACT EXPERIMENT (TADMUS) 

PARTICIPANT BACKGROUND QUESTIONNAIRE 


NAME: _ 

TEAM #: _:_ 

TEAM POSITION (Circle One): TAO AAMC TIC IDS EWS 
SITE (Circle One): SWOS NPS 

GENDER (Circle One): MALE FEMALE 

AGE (Nearest year): _ 

BRANCH OF SERVICE (Circle One): AIRFORCE ARMY MARINES NAVY 

OTHER: _ 


RANK: _ 

EDUCATION (Highest Degree Attained): 
TRAINING SCHOOLS ATTENDED: 


LAST TWO JOBS/POSITIONS: 1. 

2 . 

LAST COMMAND POSITION:_ 

TIME AT SEA: _ 

EXPERIENCE LN CIC: _ 


Thank You 


no 


APPENDIX B. DEPENDENT VARIABLES 


The following Appendix displays the dependent variables 
for the communication measures. All Rates are "per minute". 

VARIABLE VARIABLES DESCRIPTION 

AC1 Total Communication (any utterance spoken) 

AC2 Total Communication Rate 

AC3 TAO Communication Rate 

AC4 Subordinate Communication Rate 

AC5 TIC Communication Rate 

AC6 IDS Communication Rate 

AC7 AAWC Communication Rate 

AC8 EWS Communication Rate 

AC9 Upward Communication Rate (subords to TAO) 

AC10 Lateral Communication Rate (subords to subords) 

AC11 Downward Communication Rate (TAO to subords) 

AC12 Outward Communication Rate (TAO to outside entity) 

AC13 Total Request Rate (all requests made by team) 

AC14 Total Transfer Rate (all transfers made by team) 

AC15 Total Acknowledgment Rate (all acknow by team) 

AC16 Total TAO Request Rate (all requests by TAO) 

AC17 Total TAO Transfer Rate (all transfers by TAO) 

AC18 Total TAO Acknowledgment Rate (all Acknow by TAO) 

AC19 Total Subord Request Rate (all Reqs by subords) 

AC20 Total Subord Transfer Rate (all Trans by subords) 

AC21 Total Subord Acknowledge Rate (all Acknow by subs) 

AC22 Total Information Rate (info requests & transfers 

by the TAO plus info requests & transfers by subs) 

AC23 Total Action & Task Rate (A&T requests & transfers 

by the TAO plus A&T requests & transfers by subs) 

AC24 Total Problem Solving & Planning Rate (same as 

AC22 and AC23, replace with PS&P) 

AC25 Information by TAO (info reqs plus trans by TAO) 

AC26 Action & Task by TAO (A&T reqs plus trans by TAO) 

AC27 Problem Solving & Planning by TAO (PS&P requests 

plus PS&P transfers by the TAO) 

AC28 Information by Subordinates (information requests 

plus information transfers by subordinates) 
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AC2 9 

AC3 0 

AC31 
AC32 
AC33 
AC34 
AC35 
AC3 6 
AC37 
AC3 8 
AC39 
AC40 
AC41 
AC42 
AC 4 3 

AC44 

AC45 

AC46 

AC47 

AC48 

AC49 

AC50 

AC51 

AC52 


Action & Task by Subordinates (A&T requests plus 
A&T transfers by subordinates) 

Problem Solving & Planning by Subordinates (PS&P 
requests plus PS&P transfers by subordinates) 

TAO Information Request Rate 

TAO Information Transfer Rate 

TAO Action & Task Request Rate 

TAO Action & Task Transfers Rate 

Subordinate Information Request Rate from the TAO 

Subordinate Information Transfer to the TAO 

Subordinate A&T Request Rate From the TAO 

Subordinates A&T Transfer Rate to the TAO 

Subord Information Request Rate from Subordinates 

Subord Information Transfer Rate to Subordinates 

Subord A&T Request Rate from Subordinates 

Subord A&T Transfer Rate to Subordinates 

Overall Upward Anticipation Ratio(all msgs sent to 
the TAO/all msgs sent to subords by the TAO) 

Transfer Vs Request Antic ratio AC14/(AC14 + AC13) 

Transfer Vs Request Anticipation ratio for TAO 
(TAO transfers to subords/TAO requests to subords, 
AC17/(AC17 + AC16)) 

Transfer Vs Request Anticipation Ratio for Subords 
(subord transfers to TAO/subord requests to TAO) 

Information Transfer Vs Request Anticipation Ratio 
for the TAO (TAO info transfer to subs/TAO info 
requests to subs) 

A&T Transfers Vs Request Antic Ratio for TAO (A&T 
transfers by TAO to subs/A&T reqs to subs by TAO) 

Anticipation ratio for Information Transfer Vs 
Request to/from TAO (subord to TAO info transfers/ 
subord to TAO info requests) 

Anticipation ratio for A&T Transfers Vs Requests 
to/from TAO (subord to TAO A&T transfers/subord to 
TAO A&T requests) 

Anticipation Ratio for Information transfers Vs 
Requests to/from subords (subord to subord info 
transfers/subord to subord info requests) 

Anticipation Ratio for A&T Transfers Vs A&T 
Requests to/from subords (subord to s ub ord A&T 
transfer/subord to subord A&T requests) 
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AC53 

AC54 

AC55 

AC56 


Anticipation Ratio for (subordinate info transfer 
to the TAO/TAO info requests from subords) 
Anticipation Ratio for (subord A&T transfer to the 
TAO/TAO A&T request from subordinates) 

Anticipation Ratio for (TAO info transfer to 
subords/subords info requests from TAO) 

Anticipation Ratio for (TAO A&T transfers to 
Subords/subords A&T requests from the TAO) 
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APPENDIX C. DATA SPREADSHEETS 


This Appendix displays the coding forms used to 
interpret the data spreadsheets, followed by the data 
spreadsheets themselves. 


COLUMN 

VARIABLE 

IDENTIFIER 

A 

Site 

1 = SWOS Newport 

2 = NPS Monterey 

B 

Experimental 

Condition 

1 = Control 

2 = TACT 

3 = TACT + 

C 

Team ID 

One through six 

D 

Observation 

2 = Posttraining 

E 

Scenario 

One or two 

F 

Stress Level 

1 = Low 

2 = High 

G 

Trial 

Three or four 


Table 5. Data Coding Scheme for AAW Performance Spreadsheet 


COLUMN 

VARIABLE 

IDENTIFIER 

A 

Site/Team 

11 = SWOS Team 1 

12 = SWOS Team 2 

13 = SWOS Team 3 



14 = SWOS Team 4 



15 = SWOS Team 5 

24 = NPS Team 4 

26 = NPS Team 6 

B 

Class 

1 = Superior 

2 = Good 

c 

Stress Level 

1 = Low 

2 = High 

D 

Period 

1 = Period 1 

2 = Period 2 

3 = Period 3 


Table 6. Data Coding Scheme for Communications Spreadsheet 
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COLUMN 

A 


VARIABLE 

Site ID/Team 


IDENTIFIER 


11 = SWOS Team 

12 = SWOS Team 

13 = SWOS Team 

14 = SWOS Team 

15 = SWOS Team 
24 = NPS Team 
26 = NPS Team 


n 


B 

Class 

1 = Superior 

2 = Good 

C 

Stress 

1 = Low 

2 = High 

D 

Member 

0 = TAO 

1 = IDS 

2 = TIC 

3 = AAWC 

4 = EWS 

E 

Trial 

3 OR 4 


Table 7. Data Coding Scheme for Post Mission/TLX Data 


116 


CT\ tfc* l_n u> tsj I - 1 



























in 

oo 


ai 

VO 

in 

uTT 

ai 

9 

91 

ai 

ai 

31 

31 

in**" 

31 

31 

31 

31 

00 

31 

31 

31 

00 


VO 

ro 

iH 


rH 


in 

m 

rH 

9 

9 


in 

in 





in 

m 

in 

in 

in 

in 

in 

as 

Perf 










1 

















in 

co 

ro 

CN 

in 

in 

ro 

00 

ro 

in 

in 

00 

in 

in 

9 

91 

in 

Tf 

vo 

VO 

in 

3 

3 



m 

ro 

CN 



in 

in 

ro 

rH 

VO 

in 


O' 




9 

VO 





1 



a 

44 

u 

<1) 

cu 















1 

1 





1 

1 

1 


■ 


00 

CN 

ro 


91 

in 

00 

00 

9 

9 

00 

ro 

in 

in 

in 

in 

vo 

in 

in 

in 

in 


in 

vo 

1 


CN 




B 

in 

CN 

rH 

9 

9 


in 

in 

m 

** 




m 

in 

in 


in 


l 

44 

u 

0) 

a* 





1 




1 

i 















■ 


in 

in 

in 

rO 

VO 

00 


00 

in 

ro 

00 

in 


in 

ro 


in 


vo 

00 

■o* 

9 

9 

in 


ro 

ro 

CN 

ro 



in 


rH 

VO 

VO 




CN 








1 

1 

O' 

1 

Perf 






















1 

1 





in 

in 

ro 

VO 

00 

in 

ro 

in 

VO 

in 

00 

VO 

in 

in 

in 

vo 

in 

VO 

in 

in 

vo 

in 

in 


CN 


ro 

CN 



in 

T}« 


VO 


ro 

ro 



in 

in 




VO 

in 




H 

44 

u 

<11 

& 



























ro 

ro 

in 

□ 

□1 

in 

ro 

CN 

ro 

in 

a 

31 

ro 

*3* 

3 


31 

31 

in 

3 

3 

31 

3 

3 


rH 



<N 



in 

ro 


vo 

in 

- 






in 


in 

in 

* 


vo 

m 

H 

Perf 


1 

1 

1 

1 

1 

1 

1 


1 

1 

1 

1 

1 

1 

1 

1 

I 

1 

1 


1 

I 

1 



B 












B 



B 









! 

trial 




1 


1 












1 









B 


B 


B 


B 




B 




fl 










S 














1 




1 










Q 






Q 




D 






□ 







CN 

B 

I 



1 


1 


1 







1 

1 













51 




51 


51 



Q 




B 


B 

B 




G3 



i 





1 























D 

□ 



ESI 

□ 

□ 

□ 


□ 

□ 


9 

B 

Q 

m 

Q 



□ 




□ 


Q 

H 

I 

I 

1 


I 



H 


1 



1 

I 

1 

H 

1 

1 


M 


H 



u 

U 

1 




1 

1 

l 




1 


1 

1 

1 







1 


1 


Tl 

m 






D 

H 







B 

□ 





s 

B 



n 

c 

0 

u 

n 


I 

I 

I 






! 


i 





i 

1 


I 




1 


& 

0) 

1 

1 

1 







B 


B 



l 






B 

B 


1 


1 


B 

B 


B 

B 

B 

B 



B 

B 




B 

i 

| 







E 

site 




1 








1 














IB 
























1 


117 


































14 


14 





14 


14 




—■ 

— 

— 

— 

—T 

— 

—r 

— 

— 1 





0 


0 





0 


0 

















•H 


•*4 





•H 


•H 













N 

w 



14 


m 





14 


u 













w 

V 

Tl 

a; 

T5 

0) 





0) 


aj 














fO 

0 

0 


0 

m 





a 


a 














r— 1 

0 

0 

P 

0 

p 





p 


p 














u 

u 

u 


u 

w 





cn 


U) 













■ 

g 

r~ 

in 


in 

r* 

co 

in 

ro 

C" 

in 


in 













■ 

40 

r* 

r4 

r- 

40 

ro 

CM 

co 

r4 

^3» 

rH 

CN 














< 

r4 


^3* 

CO 

40 

co 

r4 

00 

04 


^3* 

ro 













B 




o 


rH 

co 

00 

o 

P* 

m 

in 

« 













fO 

r- 

CN 


• 

<T\ 

in 


in 

04 


in 

in 














JJ 

• 


• 

CN 

• 

• 


♦ 



• 















0 

CN 


in 


in 




















■ 

•D 



























in 

r- 

in 

co 

in 

co 

r- 

in 

co 

ro 

ro 

















40 

r- 

co 

CM 

ro 

40 

40 

CO 

ro 

ro 

40 














Di 

^3* 

rH 


00 

40 

00 

rH 

• 

co 

ro 

m 

rH 













X 



• 

o 


in 

rf 


00 

ro 

00 

04 














CM 

CN 

in 

o 

in 

04 



in 


in 

rH 














Di 

> 


CN 


CN 






in 

r3» 

in 









































ro 

ro 

co 


CO 

co 

ro 

r* 

in 


















ro 

CO 

co 

lO 

ro 

ro 

co 

40 

p* 

















3 

00 

00 

CO 

40 

co 

00 

co 

40 

ro 

















0 

o 

o 

CO 

40 

O 

o 

co 

40 


















H 

o 


co 

in 

CN 

CM 

r4 

ro 

m 

















0) 

ro 

CN 

in 

CO 

40 

■<* 

in 

^3* 


















□ 

■ 

■ 

B 

Bi 



■ 

■ 

















■ 


□ 



□ 






□ 















■ 


B 
























■ 


B 


























1 









1 















■ 





■ 






B 
















■ 

B 

B 



B 

B 



















D 

| 


I 

| 


| 

| 






















fl 

























1 


1 


1 

1 





















ro 

in 

CO 

r 

ro 

m 

r* 

co 

CO 

in 

frn 

ro 

ro 

c^ 

r* 

m 

m 

ro 

r- 

ro 

in 

ro 

ro 




ro 

p* 

CO 

40 

co 

r 

40 

CO 

CO 

CM 

ro 

ro 

ro 

40 

40 

40 

r 

co 

40 

ro 

CM 

ro 

ro 

40 



00 

** 

00 

rH 

ro 


40 

00 

CO 

40 

00 

co 

co 

rH 

40 


ro 

co 

40 

ro 

in 

rO 

00 

rH 

M 

0) 

& 

o 


o 


co 


40 

o 

o 


o 

m 

00 


40 


• 

00 

40 

ro 

• 

00 

in 

04 

H 

o 

CN 

r** 

CN 

co 

in 

in 

o 

CM 

in 

CN 

04 

rH 


ro 


in 

in 



Tji 

in 


rH 

1 

5 

> 

co 


CN 

CN 

in 


ro 

CN 

40 




in 

rf 





in 

in 


M 1 

in 

in 

■ 

<d 



























CN 

a 

Q 

□ 

Q 

40 

CO 

co 

CO 

□ 

ro 

Q 

Q 

Q 

Q 

□ 

□ 

in 

in 

in 

40 

Q 

Q 



P6 


r4 

CN 




in 

rH 

40 


in 

in 

in 


ro 




40 



ro 

40 


00 

4-1 


























>4 


























<D 


























ft 



























in 

IQ 

in 

in 

□ 

-O' 


CO 

CO 

in 

Q 


□ 

Q 

Q 

m 

in 

in 

40 

in 

in 

in 

in 

40 


U 

cr\ 

ro 

r4 

CN 

rH 




CN 

40 

ro 

B 






in 

in 


rf 


in 



£ 

4-1 





































fl 















a; 











B 















ft 



b 

'Hi 


■ 

■ 

IB 

m 

B 



IB 

B 

IB 

IB 

B 

IB 

IB 




IB 

H 

fl 


CN 

in 

IQ 

IQ 


IS 

IQ 


IS 

Q 





a 





in 

in 

m 


Q 


£ 

Ov 


CN 

i 

B 



1 


1 

i 





B 





in 

CM 



H 

B 

44 




B 

I 

1 

1 


1 

H 





I 









fl 

IB 




B 


fl 

fl 

fl 





& 



fl 









B 

fl 

0) 









fl 



fl 












B 

■ 

ft 



B 

fl 

B 

fl 

■ 


fl 

fl 


B 



■ 





■1 




B 



ro 


in 

CO 


co 

00 

in 

ro 

ro 

in 

in 

in 

in 

in 

*3* 

vo 

CN 

in 

in 

co 


in 

in 


9a 



t-4 



in 

CN 

r4 

40 

40 

ro 

in 

in 


^3* 





in 



40 


& 

44 




















































0) 


























ft 



























00 

|Q 

IQ 

CO 

40 

|Q 

Q 

CN 

IQ 

□ 

in 

IQ 

ro 

IQ 

ro 

IQ 

40 

in 

co 

00 

ao 

in 

40 

in 


00 

CN 

CN 


CN 


in 

ro 


40 




in 

M 1 





40 

in 




in 

o 

44 


























14 


























01 


























ft 
























IB 



in 

00 

Q 


40 

co 

co 

CO 

in 

40 

ro 

in 

40 

40 

00 

in 

in 

in 

00 

00 

ro 

N* 

in 

Q 



CN 

CN 

1 



in 

CN 

CN 

40 


in 

in 



^3* 


in 

in 


^3* 




B 

z 

44 
























1 


14 
























■ 


4> 


























ft 



■ 





















■ 

■ 

H 

IB 

IB 

■ 

B 

m 

m 

m 

m 

19 

IB 

IB 

IB 

IB 

IB 

IB 

IB 

IB 

IP 

IP 

fl 

P 

fl 

B 

n 

1 

IB 

B 

IB 

IB 

IB 

IB 

i 

B 

Ib 

Ib 

m 

Ib 

Ib 

Ib 

IB 

Ib 

Ib 

Ib 

Ib 

Ib 

Ib 

B 


118 









































ICATION DATA SPREADSHEET 


























COMMUNICATION DATA SPREADSHEET 




CTi 

O 

r- 

H 

ro 

rH 

(TV 

o 

CO 

n 

CD 

ro 

vo 

CO 

CO 

CO 

VO 

04 

ao 

rH 

04 

04 

o 

r- 

rH 

no 

rH 

co 

rH 

r- 

f-H 

in 

XT 

oo 

rH 

ro 

ro 

P 

in 

vo 

CO 

rH 

rH 

O' 

in 

xT 

in 

cn 

cn 

VO 

cn 

m 

cn 

7* 

VO 

O' 

04 

o 

ao 

rH 

In 

un 

cn 

co 

rH 

r- 


m 

cn 

XT 

cn 

O' 

04 

un 

o 

rH 

a 

VO 

o 

o 

o 

o 

O 

O 

o 

o 

o 

o 


rH 


o 

o 

o 

o 

o 

o 

O 

o 

o 


O 

o 

o 

O 

o 

rH 

o 

o 


O 

o 

O 

o 


o 

O 

o 


o 

i 

04 

0 

JO 













































04 

CO 

O' 

vo 

04 

cn 

O' 

04 

m 

00 

if) 

rH 

04 

CD 

m 

rH 

O' 

XT 

.91 

CO 

CO 

CO 

.27 

O' 

VO 

ro 

rH 

04 

ao 

04 

rH 

ro 

rH 

in 

vo 

x* 

vo 

cn 

X? 

OH 

vo 

in 

m 

O' 

vo 

O' 

04 

Xjl 

vo 

O' 

VO 

04 

OH 

OH 

o 

rH 

VO 

OH 

rH 

O- 

VO 

VO 

ro 

m 

O' 

O' 

vo 

CD 

VO 

. 55 

in 

o 

cn 

in 

8 

un 

04 

u 

JO 

o 

o 

o 

O 

o 

rH 

rH 


04 

rH 


04 

rH 


rH 

a 


04 

rH 


rH 

04 


04 

rH 

o 

fH 

O 

rH 

o 

o 


O 


rH 

rH 

o 

o 

o 

o 


rH 



GO 

rH 

o 

VO 

04 

cn 

o 

o 

CO 

04 

crv 

O 

o 

04 

CO 

.18 

o 

m 

rH 

o 

O 

o 

OH 

o 

r- 

rH 

in 

rH 

CO 

rH 

r- 

H 

rH 

in 

CD 

rH 

O 

04 

CO 

OH 

o 

—- 

o 

cn 

rH 

o 

O' 

rH 

"o" 

o 

o 

o 

o 

O' 

rH 

OH 

o 

o 

o 

p 

o 

° 

O' 

rH 

O- 

o 

2 


o 


o 

o 


O 

o 


o 

o 


o 




o 

o 

O 

o 

o 

o 

o 


o 

o 


O 


O 






O 

o 



o 


O 

o 


xt 











































1 

os 

u 

JO 





































1 






■ 


CD 

l> 

VO 

T-l 

o 

O' 

04 

CO 

vo 

00 

CO 

rH 

vo 

CO 

O' 

in 

ro 

OH 










in 

cn 


04 

i—t 

rH 

in 

m 

a 

0 

cn 

ro 

rH 

in 

CD 

■ 


rH 

rH 

XT 




oo 

CO 

. 

O' 

rH 

co 


CO 

cn 

XT 

in 

CO 

rH 

O' 

ro 

rH 

X* 

CO 

OH 

cn 

cn 

CO 

X# 

cn 

04 

CO 


VO 

xT 

m 

13 


cn 

VO 


J 

CO 

1 

cn 

(N 

U 

f0 

° 

o 

o 

o 

o 

o 

o 

O 

o 

rH 

rH 

rH 

o 

o 

o 

o 

O 

rH 

o 

o 

rH 

O 

rH 

o 

rH 

rH 

o 

rH 

04 

04 

o 


O 

rH 

04 

1 

1 

O 

o 



o 



o\ 

m 

CO 

CO 

n 

04 

in 

o- 

CT\ 

04 

CO 

Ch 

ro 

CO 

ro 

o 

in 

O' 

vo 




in 

m 



04 

OH 

in 

xf 

vo 

O' 

ro 

un 

O' 

xT 

cn 

O' 

XT 

rH 

O' 

04 



o 

m 

O 

O' 

CO 

<7\ 


VO 

rH 

00 

ao 

m 


CO 


04 


VO 

CO 


O 

O' 

m 

o 

VO 

o 


O' 

cn 

rH 

VO 

xT 

VO 

un 


VO 

O' 

cn 

iH 

CO 


















vo 










xT 
















N 


m 

m 

m 

04 

ro 

CO 


CO 

in 

in 

vo 



xt 


m 


in 

vo 


x? 

in 


vo 

xT 

04 


cn 


cn 

cn 

xT 

cn 

cn 

m 

cn 


04 

04 

XT 

cn 

xT 

OS 












































04 

0 

flj 























1 

1 

1 

i 

1 

1 

1 

1 

1 

1 

1 




1 

1 

1 

1 





<7\ 

in 

04 

VO 

O 

CO 

vo 

O' 


rH 

CO 

ro 

<T\ 

in 

04 


O' 

■O' 

O' 

O' 

CD 

in 

O'" 

oo 

X? 

O' 

cn 

r-H 

un 

cn 

XT 

cn 

CD 

VO 

O' 

04 

un 

o 

xT 

O' 

O' 

O' 



a 

’ 

O 

o 

m 


CO 

CO 

vo 

rH 

a> 

ro 

O 

O 

. 

o 

rH 


vo 

CO 

04 

rH 

O 

X? 



vo 

rH 



o 

in 

VO 

ro 

• 


cn 

VO 

- 

un 

• 

rH 

* 

cn 

04 

rH 

° 

>* 

i—( 

04 

0 

to 

o 



1 

1 

1 

1 

1 

1 

1 

1 

1 

1 















I 

1 

1 

1 

I 

I 

I 

1 

I 

I 

I 




I 

m 


E 

OJ 

xt 

xt 

O' 

in 

VO 

in 

ro 

in 

CO 

ao 

xT 

ro 

VO 

in 

ro 

OH 

04 

04 

o 

ro 

ro 

O' 

OH 

o- 

Xj< 

04 

O' 

X* 

OH 

un 

VO 

o- 

cn 

OH 

xT 

cn 

04 

XT 

cn 

xT 

I 


1 


CD 

vo 

iH 

GO 

CO 

rH 

O 

in 



VO 

ro 

rH 

r 

® 

• 

VO 

CD 



O' 

ro 

cn 

o 

VO 

04 


rH 

X# 

o 

04 

xj« 

04 

cn 

in 

VO 

ro 

OH 


m 

cn 

D 


1 


8 

8 

8 

8 

8 

1 

8 

8 

1 

8 

8 

8 

I 

8 

8 

8 

8 


8 

8 

8 

8 

8 

8 

1 

1 



8 

1 

1 

H 

8 

8 

8 

8 

8 


04 

04 

1 

1 

1 

1 

1 

1 

1 


1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 


1 

1 

1 


1 



1 

1 

1 




■ 



H 

ES 

H 

H 

E 

rH 

o- 

04 

CO 

O' 


e 

E 

E 

E 


rs 

n 

ns 

E 


E 

[S 

E 

H 

E 

E 

O' 

rH 

cn 

O' 

O' 

n 

□ 

E 

cn 

O' 

E 

OH 

in 

CD 

l 


B 

VO 

O' 


rH 

in 


VO 

CO 

O' 

rH 

o 

XT 

o 

o 

m 

ro 

xT 

rH 

rH 

co 

O' 

rH 

|9 

X? 

rH 

rH 

in 

rH 

OH 

O' 

vo 

o 

o 

m 

VO 

o 

rH 

un 

O 

rH 

VO 

B 


| 

o 

o 

o 

rH 

o 


o 

o 

o 

rH 

rH 

O 



o 

rH 

rH 

rH 

rH 

rH 

o 



rH 

rH 

rH 

rH 

rH 

rH 

rH 

rH 


rH 

rH 

rH 

o 

o 

o 

rH 


rH 

■ 


VO 

rH 

vo 


O' 

OJ 

CO 

O' 

rH 

rH 

ro 

04 

O- 

O' 

o 

in 

in 

in 

rH 

CO 

rH 

OH 

04 

vo 

OH 

O' 

cn 

CD 

cn 

OH 

a 

n 

00 

O' 

O- 

cn 

vo 

o- 

XT 

un 

cn 

xT 

I 




xr 

VO 

rH 

ON 

• 

rH 

vo 

o 


ro 

04 

• 

04 

rH 


in 

o 

xT 

OH 

ro 

OH 

o 


rH 

o 

vo 

rH 

rH 

co 

VO 

3 

H 

rH 

04 

VO 

un 

cn 

vo 

m 

un 

m 

xT 

B 

ac 

o 


o 

o 

tH 

o 

rH 

o 

rH 


rH 

rH 

o 

o 


o 


O 

rH 

rH 

rH 

rH 



rH 

o 

rH 

rH 

o 

o 

1 

fij 

o 

O 

O 

O 

O 

o 

O 

o 

o 

O 

1 

rH 

u 

(0 































1 

| 











■ 


XT 

r> 

vo 

txi 

in 

a\ 

CO 

O' 

04 

in 

ro 

cn 

rH 

ro 

ro 

ro 

CO 

OH 

H 

O' 

CO 

xT 

ro 

OH 

04 

cn 

o 

CO 

cn 

cn 

OH 

O' 

VO 

un 

o- 

XT 

un 

O' 

un 

O' 

cn 

pH 



VO 

rH 

VO 

iH 

o 

VO 

rH 

rH 

04 

xt 

CO 

<7\ 

C\ 

CO 

OH 

O' 

ro 

o 


rH 

in 

VO 

cn 

OH 

00 

CD 

o 

rH 

ro 

in 

o 

vo 

OH 

• 

un 

vo 

04 

xT 

vo 

un 

04 

m 

cn 

B 

O' 

o 

o 

O 

o 


o 

rH 

rH 

04 

rH 

rH 

rH 

O 

o 

O 

o 

rH 

04 


rH 

rH 

rH 

04 

H 

O 

o 

rH 

o 

rH 

o 

o 

o 

O 

o 

rH 

rH 

O 

o 

o 

o 

o 

rH 

1 

rH 

U 

<0 













































r- 

O' 

VO 

CO 

O' 

in 

vo 

O' 

04 

in 

o- 

CO 

VO 

rH 

to 

vo 

in 

in 

O' 

O' 

CTH 

o 

O- 

VO 

CD 

cn 

vo 

04 

cn 

o- 

o- 

cn 

CD 

rH 

cn 

m 

VO 

m 

ro 

un 

O' 

xT 



04 

VO 


H 

vo 

CD 

m 

vo 

rH 

-u 1 

rH 

rH 

ro 


rO 

ro 

o 

O' 

04 

VO 

® 

04 

VO 

rH 

rH 

m 

o 

ro 

cn 

o 

04 

■ 

cn 

tH 


co 

cn 

cn 

cn 

XT 

un 

VO 

xT 


VO 

tH 

8 

O 

o 

o 

o 

o 

O 

rH 

o 


rH 

04 

04 

o 


O 

O 


o 

rH 

O 

o 

rH 

04 


rH 

o 


o 

rH 

.H 

o 

o 

O 


o 

rH 

o 

o 

o 

o 

o 

o 

m 


in 

in 

VO 

rH 

O' 

rH 

in 

CO 

in 

n 

O' 


vo 

O' 

□ 

in 

O' 

OH 

CD 

in 

OH 

in 

O' 

CO 

m 

cn 

o- 

rH 

cn 

04 

m 

O' 

un 

xT 

cn 

un 

rH 

cn 

ro 

04 

in 

rH 



xt 


VO 


rH 

CO 

in 

CO 

rH 

3 

vo 

04 

ro 

VO 

1 

in 

rH 

o 

rH 

04 

OH 

in 

vo 

CD 

O' 

ro 

vo 

CTH 

cn 

04 

o- 

rH 

o 

VO 

cn 

rH 

OH 

ro 

vo 

ro 

o 

un 

l 

in 

H 

0 

to 

o 


o 


rH 

rH 

CO 

04 

04 


ro 

CN 

rH 

o 


rH 

04 

rH 

ro 


04 

04 

04 

04 

rH 

o 

rH 

rH 

rH 

rH 

rH 

rH 

rH 

04 

04 

rH 

O 

o 

o 

o 


o 

■ 

■ 

[3 

o- 

in 

04 

O' 

■«? 

in 

O' 


in 

co 

O' 

in 

o- 

cn 

® 

O- 

00 

04 

O' 

in 

VO 

O- 

VO 

rH 

in 

O' 

CO 

in 

CD 

ro 

O' 

04 

04 

xT 

cn 

OH 

un 

O' 

O' 

O' 

un 


1 

E 

rH 

04 

CO 

vo 

in 

in 

vo 

04 


ao 

H 

m 

rH 

in 

■ 

rH 

VO 

O' 

CO 

rH 

ro 

ro 

VO 

cn 

OH 

04 

x? 

rH 


OH 

rH 


XT 

ao 


co 

O 

04 

xT 

04 

vo 

VO 

B 


2 

8 

1 

8 

8 

8 

8 

8 

8 

1 




8 

8 

8 

i 

8 


8 

1 


1 

1 

8 

1 




8 

8 


1 



8 



8 


8 

8 


1 

■ 

1 

1 

1 

1 

1 

1 

1 

1 






1 

1 

1 

1 


1 

1 


1 

1 

1 

1 



1 

1 






1 

1 


1 

1 

1 

1 



00 

ra 

in 


CO 

00 

vo 

ro 

CO 

CO 

co 

O' 

04 

in 

cn 

CO 

ro 

x* 

in 

CO 

CO 

04 

O' 

O' 

X* 

in 

m 

vo 

un 

CO 

04 

04 

CD 

OH 

O' 

rH 

OH 

un 

m 

XT 

O' 

04 



rH 

m 

04 

cn 

CD 

CO 

CO 

ro 

O 

rH 

ro 

04 

ao 

rH 

OH 

o- 

ro 

04 

XT 

ro 

04 


rH 

04 

VO 

rH 

O' 

cn 

04 

OH 



ao 

o 

rH 

o 

O 

o 

o 



rH 

o 

m 

1—t 

o 

(0 

rH 

rH 

r-4 

o 

rH 

rH 

04 

rH 

04 

04 

ro 

CO 

o 


o 

o 

rH 

04 

04 

rH 

04 


x? 

m 

04 


rH 

04 


04 



o 

04 

04 

cn 

rH 


rH 

rH 

04 

04 

■ 


in 

CO 

OH 

in 

04 

CO 

in 

CO 

if 

XT 

04 

VO 

rH 

CO 

13 

OH 

04 

OH 

VO 

CO 

rH 

rH 

O' 

ro 

OH 

O' 

cn 

in 

04 

X* 

xT 

m 

ro 

in 

O 

xT 

rH 

□ 

o 

cn 

cn 

04 



in 

co 

in 



04 

Tf 

ao 

CO 

VO 


O' 

OH 

oo 

m 

o 


ro 

ro 

ro 

04 

OH 

VO 

o 

O 

rH 

rH 

X? 


ro 

VO 

ro 

rH 

xT 

rH 

04 


a 

H 

o 

cn 

rH 

I 

CN 

o 

o 

o 

o 


rH 

rH 

O 

04 

rH 


04 

O 

o 

1 

rH 


04 

O 

rH 

rH 

o 

rH 

cn 

rH 

rH 

rH 

o 


o 

o 

o 

o 

O 

rH 

rH 



1 

rH 

rH 

04 

I 

rH 

o 















i 
























1 




■ 

tO 















■ 
























■ 




■ 

■ 

B 

■ 

■ 

B 

B 

■ 

n 

H 

n 

B 

B 

B 

H 

B 

Q 

B 

□ 

B 

0 

B 

B 

0 

0 

0 

0 

a 

0 

0 

0 

B 

0 

0 

H 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

B 

B 

B 

B 

B 

B 

H 

H 

a 

a 

H 

H 

B 

a 

H 

H 

H 

H 

a 

Q 

H 

a 

H 

a 

H 

H 

H 

H 

H 

a 

U 

y 

y 

H 

0 

Q 

H 

B 

B 

I 


120 


















COMMUNICATION DATA SPREADSHEET 



121 





























COMMUNICATION DATA SPREADSHEET 



MflBDBBBBBIBBBBBBBBSIBBjllgllUllllljBBBBBBS 


122 























o 

u 

e 

w 

u 

B 

3 

M 

*4 


CD 

00 


VO 

J 

i 

in 

*-i 

j 

r* 

CD 

rH 

rH 

rH 

in 


77 

00 




"vO 

rH 

rH 

77 

77 


in 

in 

rH 


C0 

in 

in 

in 

o 

rH 

VO 

aT 

rH 

* 

0 

U 

0 

hh 

_® 

CO 

in 

o 

a\ 

<N 

[ 

i 

in 

o 

o 

m 

m 


p* 

f-t 

p> 

rt 


<N 

rH 

m 

rH 

p7 

CN 

rH 

rH 


m 

cT 

in 

r* 

4* 

CO 

m 

in" 

rH 


in 

m 

<7V 

in 

in 

CN 

rH 

in 

p* 

rH 

r- 

e 

0 

4-1 

U 

41 

a 




rH 


vn 

r>* 

m 

vn 

00 

in 

r* 

m 

— 


o 

pH 

O 

rH 

m 

rH 

00 

o> 

m 

*~t 

in 

rH 

cn 

VO 


OV 

VO 

in 

m 

in 

OV 


in" 

OV 

00 

ov 

in 

pi 

in 

VO 

rH 

<# 

VO 

! 

j 

VO 

1 

(N 

CN 

rH 

in 

m 

•h 

m 

« 

[ 

in 

cn 


rH 


rH 

m 

m 

p*" 

hJT 

rH 

Q0" 

rH 

cn 

aT 

77 

oT 

rH 

” 

in 

1 

S 

in 

p- 

r* 

«" 

1 


1 


I 

1 

u 

o 

a 


I 

1 

i 

I 

i 

! 

1 







1 

P"! 


1 

1 

1 

[ 

I 

I 

1 

i 

I 

I 

I 

1 

1 



1 

1 

i 

j 


i 

[ 


I 

! 

i 

I 


i 

i 

i 

! 

i 

1 

1 


1 

1 

1 

[ 

1 

1 

1 

i 

1 

I 

I 

I 

I 


1 


I 

i 

T» 

r* 

u 

a 

a 

VO 


VO, 


m 

m 

L 


VO 

VO 

VO 

VO 

m 

in 

VO 

VO 

VO 

VO 

p* 

p* 

1 

1 

VO 

VO 

1 

CO 

p* 

VO 

in 



P» 

P- 

VO 


p* 

■u 

B 

& 

p* 


m 

in 

VO 

in 



VO 

in 

« 

r* 



m 

VO 

VO 

VO 

p* 


in 

CN 

p* 

VO 

VO 

m 

r-> 

VO 

m 

m 

p* 

P* 

VO 

VO 

! 

VO 

VI 

a 

a 







1 











i 

1 


I 

i 

1 

1 






1 

i 


i 

1 


8 

1 

1 

1 

1 

1 

1 

i 

i 

1 

1 

1 

1 

1 

i 


1 

1 

i 

1 


1 

1 

I 

1 

i 

1 

1 

i 

I 

I 

1 


I 

1 

O 

CN 

U 

a 

a 

VO 

VO 

VO 

VO 

VO 

VO 

vO 

m 

VO 

VO 

r- 

r* 

m 

in 


VO 

VO 

r> 

p* 


VO 



p* 

VO 

in 

r* 

VO 

VO 

VO 

P* 

VO 

p* 

p* 

1 























1 













1 

*3 

Vi 


m 


r-i 


m 

, 


cn 

1 

i 

1 

i 

i 

1 


i 

1 



















M 

s 

o 

o 



CN 

CN 

n 



i 

1 


1 






















1 

a 

« 

V 

u 

u 

a 










i 

1 


1 

i 


1 



















1 




1 

1 

1 

1 

I 

I 

1 

1 

1 



I 


1 



















1 






1 

[ 

I 

I 

I 

i 

1 

1 


1 

1 

1 

1 



1 


m 

cn 


1 

1 

1 

1 


cn 

i 


1 



B 

B 

B 

B 

B 

B 

B 

B 

fl 

a 

a 

a 

a 

a 

a 

a 

a 

a 

a 

a 

a 

a 

EJ 

ia 

a 

a 

a 

a 

a 

a 

ia 

a 

a 

a 

a 


123 



















POST MISSION TLX DATA SPREADSHEET 



IBBBB333BBBBBBBBBBBB33BBB1BBB1B1B111B 


124 





















125 








APPENDIX D. BACKGROUND QUESTIONNAIRE DATA 



127 


































































128 



APPENDIX E. UNIVARIATE ANALYSIS OF VARIANCE FOR 
COMMUNICATION VARIABLES (GENERAL LINEAR MODEL) 

The following Appendix displays the p-values for the 


communication variables with 

regards 

to the 

independent 

variables; Class, 

Stress, and 

Period. 




Analysis of Variance 

for 

acl 






Source 

DF 


Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 


3632.2 

3632.2 

3632.2 

5.43 

0.027 

Stress 

1 


2768.6 

2583.1 

2583.1 

3.86 

0.059 

Period 

2 


23211.6 

21424.0 

10712.0 

16.01 

0.000 

Class*Stress 

1 


77.0 

77.0 

77.0 

0.12 

0.737 

Class*Period 

2 


1277.7 

1277.7 

638.9 

0.96 

0.396 

Stress*Period 

2 


235.6 

178.8 

89.4 

0.13 

0.875 

Class*Stress*Period 

2 


187.2 

187.2 

93.6 

0.14 

0.870 

Error 

30 


20066.3 

20066.3 

668.9 



Total 

41 


51456.1 





Analysis of Variance 

for 

ac2 






Source 

DF 


Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 


20.655 

20.655 

20.655 

4.36 

0.045 

Stress 

1 


40.671 

38.429 

38.429 

8.11 

0.008 

Period 

2 


0.302 

0.232 

0.116 

0.02 

0.976 

Class*Stress 

1 


0.624 

0.624 

0.624 

0.13 

0.719 

Class*Period 

2 


0.421 

0.421 

0.211 

0.04 

0.957 

Stress*Period 

2 


9.291 

8.278 

4.139 

0.87 

0.428 

Class*Stress*Period 

2 


1.262 

1.262 

0.631 

0.13 

0.876 

Error 

30 


142.068 

142.068 

4.736 



Total 

41 


215.294 





Analysis of Variance 

for 

ac3 






Source 

DF 


Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 


13.554 

13.554 

13.554 

7.53 

0.010 

Stress 

1 


8.514 

7.908 

7.908 

4.39 

0.045 

Period 

2 


4.130 

3.824 

1.912 

1.06 

0.359 

Class*Stress 

1 


0.282 

0.282 

0.282 

0.16 

0.695 

Class*Period 

2 


0.189 

0.189 

0.094 

0.05 

0.949 

Stress*Period 

2 


4.505 

4.011 

2.006 

1.11 

0.342 

Class*Stress*Period 

2 


0.485 

0.485 

0.242 

0.13 

0.875 

Error 

30 


54.028 

54.028 

1.801 



Total 

41 


85.687 





Analysis of Variance 

for 

ac4 





Source 

DF 


Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 


0.738 

0.738 

0.738 

0.48 

0.496 

Stress 

1 


11.915 

11.421 

11.421 

7.36 

0.011 

Period 

2 


3.066 

3.084 

1.542 

0.99 

0.382 

Class*Stress 

1 


0.067 

0.067 

0.067 

0.04 

0.837 

Class*Period 

2 


0.130 

0.130 

0.065 

0.04 

0.959 

Stress*Period 

2 


0.999 

0.926 

0.463 

0.30 

0.744 

Class*Stress*Period 

2 


0.208 

0.208 

0.104 

0.07 

0.935 

Error 

30 


46.584 

46.584 

1.553 



Total 

41 


63.707 
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Analysis of Variance for ac5 


Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

1.1524 

1.1524 

1.1524 

2.40 

0.132 

Stress 

1 

0.2577 

0.2579 

0.2579 

0.54 

0.469 

Period 

2 

0.0829 

0.0519 

0.0259 

0.05 

0.948 

Class*Stress 

1 

0.0014 

0.0014 

0.0014 

0.00 

0.957 

Class*Period 

2 

0.1645 

0.1645 

0.0822 

0.17 

0.843 

Stress*Period 

2 

0.5758 

0.4539 

0.2269 

0.47 

0.628 

Class*Stress*Period 

2 

0.6746 

0.6746 

0.3373 

0.70 

0.503 

Error 

30 

14.4076 

14.4076 

0.4803 



Total 

41 

17.3170 






Analysis of Variance 

for ac6 






Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.5674 

0.5674 

0.5674 

2.35 

0.135 

Stress 

1 

0.0721 

0.0342 

0.0342 

0.14 

0.709 

Period 

2 

0.7058 

0.6891 

0.3446 

1.43 

0.255 

Class*Stress 

1 

0.3205 

0.3205 

0.3205 

1.33 

0.258 

Class*Period 

2 

0.0129 

0.0129 

0.0064 

0.03 

0.974 

Stress*Period 

2 

0.2198 

0.1415 

0.0708 

0.29 

0.748 

Class*Stress*Period 

2 

0.4554 

0.4554 

0.2277 

0.94 

0.400 

Error 

30 

7.2308 

7.2308 

0.2410 



Total 

41 

9.5847 






Analysis of Variance 

for 

ac7 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

5.5503 

5.5503 

5.5503 

6.53 

0.016 

Stress 

1 

1.4560 

1.4863 

1.4863 

1.75 

0.196 

Period 

2 

0.0240 

0.0666 

0.0333 

0.04 

0.962 

Class*Stress 

1 

0.0303 

0.0303 

0.0303 

0.04 

0.851 

Class*Period 

2 

0.5369 

0.5369 

0.2685 

0.32 

0.732 

Stress*Period 

2 

0.0939 

0.0548 

0.0274 

0.03 

0.968 

Class*Stress*Period 

2 

0.3708 

0.3708 

0.1854 

0.22 

0.805 

Error 

30 

25.5149 

25.5149 

0.8505 



Total 

41 

33.5772 






Analysis of Variance 

for 

ac8 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

4.4053 

4.4053 

4.4053 

18.83 

0.000 

Stress 

1 

0.7072 

0.6791 

0.6791 

2.90 

0.099 

Period 

2 

1.3553 

1.2872 

0.6436 

2.75 

0.080 

Class*Stress 

1 

0.0034 

0.0034 

0.0034 

0.01 

0.906 

Class*Period 

2 

0.0173 

0.0173 

0.0087 

0.04 

0.964 

Stress*Period 

2 

0.3831 

0.3832 

0.1916 

0.82 

0.451 

Class*Stress*Period 

2 

0.0711 

0.0711 

0.0356 

0.15 

0.860 

Error 

30 

7.0189 

7.0189 

0.2340 



Total 

41 

13.9616 
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Analysis of Variance for ac9 


Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.8016 

0.8016 

0.8016 

1.32 

0.259 

Stress 

1 

0.6815 

0.8584 

0.8584 

1.42 

0.243 

Period 

2 

0.1291 

0.1510 

0.0755 

0.12 

0.883 

Class*Stress 

1 

0.5870 

0.5870 

0.5870 

0.97 

0.333 

Class*Period 

2 

0.0813 

0.0813 

0.0407 

0.07 

0.935 

Stress*Period 

2 

0.8430 

0.8150 

0.4075 

0.67 

0.518 

Class*Stress*Period 

2 

0.1987 

0.1987 

0.0994 

0.16 

0.850 

Error 

30 

18.1776 

18.1776 

0.6059 



Total 

41 

21.4998 






Analysis of Variance 

for 

aclO 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.454 

0.454 

0.454 

0.42 

0.521 

Stress 

1 

3.981 

3.267 

3.267 

3.04 

0.091 

Period 

2 

5.579 

5.616 

2.808 

2.61 

0.090 

Class*Stress 

1 

1.368 

1.368 

1.368 

1.27 

0.268 

Class*Period 

2 

0.473 

0.473 

0.236 

0.22 

0.804 

Stress*Period 

2 

0.239 

0.237 

0.118 

0.11 

0.896 

Class*Stress*Period 

2 

0.001 

0.001 

0.000 

0.00 

1.000 

Error 

30 

32.218 

32.218 

1.074 



Total 

41 

44.313 






Analysis of Variance 

for 

acll 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

2.853 

2.853 

2.853 

1.71 

0.201 

Stress 

1 

2.526 

2.557 

2.557 

1.53 

0.225 

Period 

2 

0.501 

0.517 

0.258 

0.16 

0.857 

Class*Stress 

1 

0.033 

0.033 

0.033 

0.02 

0.888 

Class*Period 

2 

0.141 

0.141 

0.071 

0.04 

0.959 

Stress*Period 

2 

2.328 

1.899 

0.949 

0.57 

0.572 

Class*Stress*Period 

2 

0.971 

0.971 

0.485 

0.29 

0.749 

Error 

30 

49.995 

49.995 

1.666 



Total 

41 

59.348 






Analysis of Variance 

for 

acl2 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

1.6687 

1.6687 

1.6687 

6.38 

0.017 

Stress 

1 

3.8766 

3.4867 

3.4867 

13.32 

0.001 

Period 

2 

2.8102 

2.4107 

1.2053 

4.61 

0.018 

Class*Stress 

1 

0.3251 

0.3251 

0.3251 

1.24 

0.274 

Class*Period 

2 

0.7670 

0.7670 

0.3835 

1.47 

0.247 

Stress*Period 

2 

1.8807 

1.8818 

0.9409 

3.60 

0.040 

Class*Stress*Period 

2 

0.0199 

0.0199 

0.0099 

0.04 

0.963 

Error 

30 

7.8513 

7.8513 

0.2617 



Total 

41 

19.1994 
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Analysis of Variance for acl3 


Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.0045 

0.0045 

0.0045 

0.01 

0.926 

Stress 

1 

5.7720 

5.8674 

5.8674 

11.59 

0.002 

Period 

2 

0.6636 

0.4606 

0.2303 

0.45 

0.639 

Class*Stress 

1 

0.0967 

0.0967 

0.0967 

0.19 

0.665 

Class*Period 

2 

0.9566 

0.9566 

0.4783 

0.94 

0.400 

Stress*Period 

2 

3.6303 

3.4639 

1.7319 

3.42 

0.046 

Class*Stress*Period 

2 

0.3904 

0.3904 

0.1952 

0.39 

0.683 

Error 

30 

15.1881 

15.1881 

0.5063 



Total 

41 

26.7022 





Analysis of Variance 

for 

acl4 






Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

3.3565 

3.3565 

3.3565 

4.52 

0.042 

Stress 

1 

8.2371 

7.5020 

7.5020 

10.10 

0.003 

Period 

2 

0.6407 

0.7745 

0.3872 

0.52 

0.599 

Class*Stress 

1 

0.5060 

0.5060 

0.5060 

0.68 

0.416 

Class*Period 

2 

0.4395 

0.4395 

0.2198 

0.30 

0.746 

Stress*Period 

2 

1.6804 

1.6380 

0.8190 

1.10 

0.345 

Class*Stress*Period 

2 

0.5616 

0.5616 

0.2808 

0.38 

0.688 

Error 

30 

22.2791 

22.2791 

0.7426 



Total 

41 

37.7010 






Analysis of Variance 

for 

acl5 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

6.980 

6.980 

6.980 

6.96 

0.013 

Stress 

1 

1.227 

1.082 

1.082 

1.08 

0.307 

Period 

2 

1.718 

1.778 

0.889 

0.89 

0.423 

Class*Stress 

1 

0.156 

0.156 

0.156 

0.16 

0.696 

Class*Period 

2 

0.092 

0.092 

0.046 

0.05 

0.955 

Stress*Period 

2 

0.392 

0.417 

0.208 

0.21 

0.814 

Class*Stress*Period 

2 

0.085 

0.085 

0.043 

0.04 

0.959 

Error 

30 

30.092 

30.092 

1.003 



Total 

41 

40.742 






Analysis of Variance 

for 

acl6 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

1.0496 

1.0496 

1.0496 

3.49 

0.071 

Stress 

1 

2.1398 

2.0854 

2.0854 

6.94 

0.013 

Period 

2 

0.1801 

0.1232 

0.0616 

0.21 

0.816 

Class*Stress 

1 

0.0007 

0.0007 

0.0007 

0.00 

0.963 

Class*Period 

2 

0.2424 

0.2424 

0.1212 

0.40 

0.672 

Stress*Period 

2 

0.7449 

0.6744 

0.3372 

1.12 

0.339 

Class*Stress*Period 

2 

0.0535 

0.0535 

0.0267 

0.09 

0.915 

Error 

30 

9.0122 

9.0122 

0.3004 



Total 

41 

13.4232 
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Analysis of Variance for acl7 


Source 

DF 

Seq SS 

Ad: ss 

Adj MS 

F 

P 

Class 

1 

2.1476 

2.1476 

2.1476 

7.13 

0.012 

Stress 

1 

1.0498 

0.9360 

0.9360 

3.11 

0.088 

Period 

2 

2.2738 

2.2958 

1.1479 

3.81 

0.034 

Class*Stress 

1 

0.1063 

0.1063 

0.1063 

0.35 

0.557 

Class*Period 

2 

0.2678 

0.2678 

0.1339 

0.44 

0.645 

Stress*Period 

2 

0.8667 

0.8406 

0.4203 

1.39 

0.264 

Class*Stress*Period 

2 

0.0012 

0.0012 

0.0006 

0.00 

0.998 

Error 

30 

9.0413 

9.0413 

0.3014 



Total 

41 

15.7546 






Analysis of Variance 

for 

acl8 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

1.4272 

1.4272 

1.4272 

5.14 

0.031 

Stress 

1 

0.1907 

0.1650 

0.1650 

0.59 

0.447 

Period 

2 

0.0480 

0.0365 

0.0183 

0.07 

0.936 

Class*Stress 

1 

0.0330 

0.0330 

0.0330 

0.12 

0.733 

Class*Period 

2 

0.0426 

0.0426 

0.0213 

0.08 

0.926 

Stress*Period 

2 

0.1402 

0.0966 

0.0483 

0.17 

0.841 

Class*Stress*Period 

2 

0.2004 

0.2004 

0.1002 

0.36 

0.700 

Error 

30 

8.3249 

8.3249 

0.2775 



Total 

41 

10.4071 






Analysis of Variance 

for 

acl9 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.9061 

0.9061 

0.9061 

7.00 

0.013 

Stress 

1 

0.8889 

0.9629 

0.9629 

7.44 

0.011 

Period 

2 

0.1876 

0.1377 

0.0689 

0.53 

0.593 

Class*Stress 

1 

0.1137 

0.1137 

0.1137 

0.88 

0.356 

Class*Period 

2 

0.2512 

0.2512 

0.1256 

0.97 

0.391 

Stress*Period 

2 

1.1360 

1.1566 

0.5783 

4.47 

0.020 

Class*Stress*Period 

2 

0.3201 

0.3201 

0.1601 

1.24 

0.305 

Error 

30 

3.8841 

3.8841 

0.1295 



Total 

41 

7.6877 






Analysis of Variance 

for 

ac20 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.1360 

0.1360 

0.1360 

0.40 

0.533 

Stress 

1 

3.3887 

3.1209 

3.1209 

9.10 

0.005 

Period 

2 

0.6438 

0.5578 

0.2789 

0.81 

0.453 

Class*Stress 

1 

0.1502 

0.1502 

0.1502 

0.44 

0.513 

Class*Period 

2 

0.1154 

0.1154 

0.0577 

0.17 

0.846 

Stress*Period 

2 

0.3567 

0.4419 

0.2210 

0.64 

0.532 

Class*Stress*Period 

2 

0.5560 

0.5560 

0.2780 

0.81 

0.454 

Error 

30 

10.2829 

10.2829 

0.3428 



Total 

41 

15.6298 
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Analysis of Variance for ac21 


Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

2.0816 

2.0816 

2.0816 

3.08 

0.089 

Stress 

1 

0.4443 

0.3961 

0.3961 

0.59 

0.450 

Period 

2 

2.0205 

2.0138 

1.0069 

1.49 

0.241 

Class*Stress 

1 

0.0451 

0.0451 

0.0451 

0.07 

0.798 

Class*Period 

2 

0.0089 

0.0089 

0.0044 

0.01 

0.993 

Stress*Period 

2 

0.2677 

0.2814 

0.1407 

0.21 

0.813 

Class*Stress*Period 

2 

0.1278 

0.1278 

0.0639 

0.09 

0.910 

Error 

30 

20.2615 

20.2615 

0.6754 



Total 

41 

25.2574 






Analysis of Variance 

for 

ac22 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

10.432 

10.432 

10.432 

8.13 

0.008 

Stress 

1 

10.281 

8.947 

8.947 

6.97 

0.013 

Period 

2 

0.730 

0.529 

0.264 

0.21 

0.815 

Class*Stress 

1 

1.631 

1.631 

1.631 

1.27 

0.269 

Class*Period 

2 

0.995 

0.995 

0.498 

0.39 

0.682 

Stress*Period 

2 

4.111 

3.332 

1.666 

1.30 

0.288 

Class*Stress*Period 

2 

1.643 

1.643 

0.821 

0.64 

0.534 

Error 

30 

38.516 

38.516 

1.284 



Total 

41 

68.338 






Analysis of Variance 

for 

ac23 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

2.5217 

2.5217 

2.5217 

15.81 

0.000 

Stress 

1 

4.1297 

4.5126 

4.5126 

28.30 

0.000 

Period 

2 

0.4861 

0.5274 

0.2637 

1.65 

0.208 

Class*Stress 

1 

0.6251 

0.6251 

0.6251 

3.92 

0.057 

Class*Period 

2 

0.3188 

0.3188 

0.1594 

1.00 

0.380 

Stress*Period 

2 

0.4337 

0.4647 

0.2323 

1.46 

0.249 

Class*Stress*Period 

2 

0.0754 

0.0754 

0.0377 

0.24 

0.791 

Error 

30 

4.7842 

4.7842 

0.1595 



Total 

41 

13.3747 






Analysis of Variance 

for 

ac24 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.069302 

0.069302 

0.069302 

8.40 

0.007 

Stress 

1 

0.001050 

0.002024 

0.002024 

0.25 

0.624 

Period 

2 

0.084233 

0.063868 

0.031934 

3.87 

0.032 

Class*Stress 

1 

0.008176 

0.008176 

0.008176 

0.99 

0.328 

Class*Period 

2 

0.088525 

0.088525 

0.044262 

5.36 

0.010 

Stress*Period 

2 

0.023957 

0.028055 

0.014028 

1.70 

0.200 

Class*Stress*Period 

2 

0.021246 

0.021246 

0.010623 

1.29 

0.291 

Error 

30 

0.247608 

0.247608 

0.008254 



Total 

41 

0.544098 
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Analysis of Variance for ac25 


Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

5.4147 

5.4147 

5.4147 

10.34 

0.003 

Stress 

1 

2.2867 

2.0470 

2.0470 

3.91 

0.057 

Period 

2 

1.7706 

1.6740 

0.8370 

1.60 

0.219 

Class*Stress 

1 

0.2130 

0.2130 

0.2130 

0.41 

0.529 

Class*Period 

2 

0.1040 

0.1040 

0.0520 

0.10 

0.906 

Stress*Period 

2 

1.7199 

1.5307 

0.7653 

1.46 

0.248 

Class*Stress*Period 

2 

0.1968 

0.1968 

0.0984 

0.19 

0.830 

Error 

30 

15.7173 

15.7173 

0.5239 



Total 

41 

27.4230 






Analysis of Variance 

for 

ac26 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.00423 

0.00423 

0.00423 

0.05 

0.827 

Stress 

1 

0.94500 

0.94294 

0.94294 

10.89 

0.003 

Period 

2 

0.28663 

0.28564 

0.14282 

1.65 

0.209 

Class*Stress 

1 

0.00389 

0.00389 

0.00389 

0.04 

0.834 

Class*Period 

2 

0.12101 

0.12101 

0.06051 

0.70 

0.505 

Stress*Period 

2 

0.20933 

0.22764 

0.11382 

1.31 

0.284 

Class*Stress*Period 

2 

0.05332 

0.05332 

0.02666 

0.31 

0.737 

Error 

30 

2.59878 

2.59878 

0.08663 



Total 

41 

4.22219 






Analysis of Variance 

for 

ac27 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.047834 

0.047834 

0.047834 

5.87 

0.022 

Stress 

1 

0.000000 

0.000057 

0.000057 

0.01 

0.934 

Period 

2 

0.033390 

0.024996 

0.012498 

1.53 

0.232 

Class*Stress 

1 

0.002810 

0.002810 

0.002810 

0.34 

0.561 

Class*Period 

2 

0.030862 

0.030862 

0.015431 

1.89 

0.168 

Stress*Period 

2 

0.029886 

0.024593 

0.012297 

1.51 

0.237 

Class*Stress*Period 

2 

0.013584 

0.013584 

0.006792 

0.83 

0.444 

Error 

30 

0.244425 

0.244425 

0.008147 



Total 

41 

0.402790 






Analysis of Variance 

for 

ac28 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.8112 

0.8112 

0.8112 

1.66 

0.207 

Stress 

1 

2.8392 

2.4084 

2.4084 

4.94 

0.034 

Period 

2 

0.4750 

0.4729 

0.2364 

0.48 

0.621 

Class*Stress 

1 

0.6572 

0.6572 

0.6572 

1.35 

0.255 

Class*Period 

2 

0.4669 

0.4669 

0.2335 

0.48 

0.624 

Stress*Period 

2 

0.5551 

0.3987 

0.1994 

0.41 

0.668 

Class*Stress*Period 

2 

0.7468 

0.7468 

0.3734 

0.77 

0.474 

Error 

30 

14.6358 

14.6358 

0.4879 



Total 

41 

21.1873 
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Analysis of Variance for ac29 


Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

2.33022 

2.33022 

2.33022 

27.48 

0.000 

Stress 

1 

1.13029 

1.33818 

1.33818 

15.78 

0.000 

Period 

2 

0.03527 

0.04515 

0.02257 

0.27 

0.768 

Class*Stress 

1 

0.53560 

0.53560 

0.53560 

6.32 

0.018 

Class*Period 

2 

0.09494 

0.09494 

0.04747 

0.56 

0.577 

Stress*Period 

2 

0.04775 

0.06081 

0.03041 

0.36 

0.702 

Class*Stress*Period 

2 

0.13430 

0.13430 

0.06715 

0.79 

0.462 

Error 

30 

2.54419 

2.54419 

0.08481 



Total 

41 

6.85256 






Analysis of Variance 

for 

ac3 0 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.001716 

0.001716 

0.001716 

0.39 

0.534 

Stress 

1 

0.000688 

0.001000 

0.001000 

0.23 

0.635 

Period 

2 

0.014948 

0.012262 

0.006131 

1.41 

0.260 

Class*Stress 

1 

0.001572 

0.001572 

0.001572 

0.36 

0.552 

Class*Period 

2 

0.014319 

0.014319 

0.007160 

1.65 

0.209 

Stress*Period 

2 

0.006005 

0.007092 

0.003546 

0.82 

0.452 

Class*Stress*Period 

2 

0.024006 

0.024006 

0.012003 

2.76 

0.079 

Error 

30 

0.130358 

0.130358 

0.004345 



Total 

41 

0.193612 






Analysis of Variance 

for 

ac31 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.7873 

0.7873 

0.7873 

6.61 

0.015 

Stress 

1 

0.1749 

0.1434 

0.1434 

1.20 

0.281 

Period 

2 

0.0283 

0.0362 

0.0181 

0.15 

0.860 

Class*Stress 

1 

0.0609 

0.0609 

0.0609 

0.51 

0.480 

Class*Period 

2 

0.5098 

0.5098 

0.2549 

2.14 

0.135 

Stress*Period 

2 

0.1857 

0.1294 

0.0647 

0.54 

0.586 

Class*Stress*Period 

2 

0.3327 

0.3327 

0.1664 

1.40 

0.263 

Error 

30 

3.5737 

3.5737 

0.1191 



Total 

41 

5.6534 






Analysis of Variance 

for 

ac32 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.0000 

0.0000 

0.0000 

0.00 

0.999 

Stress 

1 

0.5060 

0.5073 

0.5073 

2.98 

0.095 

Period 

2 

0.1809 

0.2707 

0.1353 

0.79 

0.461 

Class*Stress 

1 

0.0033 

0.0033 

0.0033 

0.02 

0.890 

Class*Period 

2 

0.4848 

0.4848 

0.2424 

1.42 

0.257 

Stress*Period 

2 

0.3495 

0.3421 

0.1711 

1.00 

0.379 

Class*Stress*Period 

2 

0.0700 

0.0700 

0.0350 

0.21 

0.815 

Error 

30 

5.1151 

5.1151 

0.1705 



Total 

41 

6.7096 
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Analysis of Variance for ac33 


Source 

DF 

Seq SS 

Class 

1 

0.10487 

Stress 

1 

0.28834 

Period 

2 

0.15625 

Class*Stress 

1 

0.11310 

Class*Period 

2 

0.05599 

Stress*Period 

2 

0.13411 

Class*Stress*Period 

2 

0.00716 

Error 

30 

2.19837 

Total 

41 

3.05819 


Analysis of Variance 

for 

ac34 

Source 

DF 

Seq SS 

Class 

1 

0.003616 

Stress 

1 

0.000860 

Period 

2 

0.000400 

Class*Stress 

1 

0.000645 

Class*Period 

2 

0.000300 

Stress*Period 

2 

0.002133 

Class*Stress*Period 

2 

0.001600 

Error 

30 

0.034725 

Total 

41 

0.044279 


Analysis of Variance 

for 

ac35 

Source 

DF 

Seq SS 

Class 

1 

0.000229 

Stress 

1 

0.000002 

Period 

2 

0.055714 

Class*Stress 

1 

0.000287 

Class*Period 

2 

0.000555 

Stress*Period 

2 

0.021733 

Class*Stress*Period 

2 

0.003419 

Error 

30 

0.258767 

Total 

41 

0.340707 


Analysis of Variance 

for 

ac36 

Source 

DF 

Seq SS 

Class 

1 

0.2944 

Stress 

1 

0.1001 

Period 

2 

0.3267 

Class*Stress 

1 

0.0072 

Class*Period 

2 

0.0545 

Stress*Period 

2 

0.2047 

Class*Stress*Period 

2 

0.2195 

Error 

30 

7.4172 

Total 

41 

8.6242 


Adj SS 

Adj MS 

F 

P 

0.10487 

0.10487 

1.43 

0.241 

0.33583 

0.33583 

4.58 

0.041 

0.14669 

0.07335 

1.00 

0.379 

0.11310 

0.11310 

1.54 

0.224 

0.05599 

0.02799 

0.38 

0.686 

0.13634 

0.06817 

0.93 

0.406 

0.00716 

0.00358 

0.05 

0.952 

2.19837 

0.07328 




Adj SS 

Adj MS 

F 

P 

0.003616 

0.003616 

3.12 

0.087 

0.000645 

0.000645 

0.56 

0.461 

0.000300 

0.000150 

0.13 

0.879 

0.000645 

0.000645 

0.56 

0.461 

0.000300 

0.000150 

0.13 

0.879 

0.001600 

0.000800 

0.69 

0.509 

0.001600 

0.000800 

0.69 

0.509 

0.034725 

0.001158 




Adj SS 

Adj MS 

F 

P 

0.000229 

0.000229 

0.03 

0.872 

0.000001 

0.000001 

0.00 

0.992 

0.055108 

0.027554 

3.19 

0.055 

0.000287 

0.000287 

0.03 

0.857 

0.000555 

0.000278 

0.03 

0.968 

0.021191 

0.010595 

1.23 

0.307 

0.003419 

0.001710 

0.20 

0.821 

0.258767 

0.008626 




Adj SS 

Adj MS 

F 

P 

0.2944 

0.2944 

1.19 

0.284 

0.1057 

0.1057 

0.43 

0.518 

0.3558 

0.1779 

0.72 

0.495 

0.0072 

0.0072 

0.03 

0.866 

0.0545 

0.0273 

0.11 

0.896 

0.1644 

0.0822 

0.33 

0.720 

0.2195 

0.1097 

0.44 

0.646 

7.4172 

0.2472 
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Analysis of Variance for ac37 


Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.007622 

0.007622 

0.007622 

0.78 

0.383 

Stress 

1 

0.012002 

0.020317 

0.020317 

2.09 

0.159 

Period 

2 

0.003233 

0.002491 

0.001245 

0.13 

0.880 

Class*Stress 

1 

0.057003 

0.057003 

0.057003 

5.86 

0.022 

Class*Period 

2 

0.009719 

0.009719 

0.004860 

0.50 

0.612 

Stress*Period 

2 

0.010890 

0.008134 

0.004067 

0.42 

0.662 

Class*Stress*Period 

2 

0.008562 

0.008562 

0.004281 

0.44 

0.648 

Error 

30 

0.291750 

0.291750 

0.009725 



Total 

41 

0.400783 






Analysis of Variance 

for 

ac3 8 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.02362 

0.02362 

0.02362 

1.72 

0.199 

Stress 

1 

0.04937 

0.04980 

0.04980 

3.63 

0.066 

Period 

2 

0.00096 

0.00118 

0.00059 

0.04 

0.958 

Class*Stress 

1 

0.00052 

0.00052 

0.00052 

0.04 

0.847 

Class*Period 

2 

0.00075 

0.00075 

0.00038 

0.03 

0.973 

Stress*Period 

2 

0.01330 

0.01570 

0.00785 

0.57 

0.570 

Class*Stress*Period 

2 

0.00636 

0.00636 

0.00318 

0.23 

0.794 

Error 

30 

0.41136 

0.41136 

0.01371 



Total 

41 

0.50623 






Analysis of Variance 

for 

ac39 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.04072 

0.04072 

0.04072 

0.96 

0.336 

Stress 

1 

0.03486 

0.03254 

0.03254 

0.76 

0.389 

Period 

2 

0.03640 

0.03642 

0.01821 

0.43 

0.656 

Class*Stress 

1 

0.00094 

0.00094 

0.00094 

0.02 

0.883 

Class*Period 

2 

0.43756 

0.43756 

0.21878 

5.14 

0.012 

Stress*Period 

2 

0.16785 

0.16503 

0.08252 

1.94 

0.162 

Class*Stress*Period 

2 

0.01526 

0.01526 

0.00763 

0.18 

0.837 

Error 

30 

1.27769 

1.27769 

0.04259 



Total 

41 

2.01128 






Analysis of Variance 

for 

ac40 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.1413 

0.1413 

0.1413 

0.44 

0.512 

Stress 

1 

0.9182 

0.7238 

0.7238 

2.26 

0.144 

Period 

2 

1.0027 

0.9592 

0.4796 

1.49 

0.241 

Class*Stress 

1 

0.4669 

0.4669 

0.4669 

1.45 

0.237 

Class*Period 

2 

0.0650 

0.0650 

0.0325 

0.10 

0.904 

Stress*Period 

2 

0.2842 

0.3089 

0.1544 

0.48 

0.623 

Class*Stress*Period 

2 

0.0427 

0.0427 

0.0213 

0.07 

0.936 

Error 

30 

9.6287 

9.6287 

0.3210 



Total 

41 

12.5498 
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Analysis of Variance for 


Source DF 
Class 1 
Stress 1 
Period 2 
Class*Stress 1 
Class*Period 2 
Stress*Period 2 
Class*Stress*Period 2 
Error 22 
Total 33 


Analysis of Variance for 


Source DF 
Class 1 
Stress 1 
Period 2 
Class*Stress 1 
Class*Period 2 
Stress*Period 2 
Class*Stress*Period 2 
Error 30 
Total 41 


Analysis of Variance for 


Source DF 
Class 1 
Stress 1 
Period 2 
Class*Stress 1 
Class*Period 2 
Stress*Period 2 
Class*Stress*Period 2 
Error 30 
Total 41 


Analysis of Variance for 


Source DF 
Class 1 
Stress 1 
Period 2 
Class*Stress 1 
Class*Period 2 
Stress*Period 2 
Class*Stress*Period 2 
Error 30 
Total 41 


ac41 

Seq SS Adj SS 
0.74298 0.76614 
0.04951 0.01213 
0.00053 0.00352 
0.03570 0.01366 
0.06429 0.09239 
0.12002 0.13723 
0.03342 0.03342 
1.25224 1.25224 
2.29870 


ac42 

Seq SS Adj SS 
0.001572 0.001572 
0.001488 0.001367 
0.059443 0.049996 
0.000072 0.000072 
0.025643 0.025643 
0.001176 0.001234 
0.000443 0.000443 
0.151442 0.151442 
0.241279 


ac43 

Seq SS Adj SS 
0.00883 0.00883 
0.00829 0.01077 
0.00996 0.01192 
0.00917 0.00917 
0.00578 0.00578 
0.00493 0.00514 
0.00034 0.00034 
0.44392 0.44392 
0.49124 


ac44 

Seq SS Adj SS 
0.017738 0.017738 
0.012002 0.015891 
0.000476 0.000103 
0.015224 0.015224 
0.040560 0.040560 
0.042590 0.045348 
0.006929 0.006929 
0.183492 0.183492 
0.319012 


Adj MS 

F 

P 

0.76614 

13.46 

0.001 

0.01213 

0.21 

0.649 

0.00176 

0.03 

0.970 

0.01366 

0.24 

0.629 

0.04619 

0.81 

0.457 

0.06861 

1.21 

0.319 

0.01671 

0.05692 

0.29 

0.748 


Adj MS 

F 

P 

0.001572 

0.31 

0.581 

0.001367 

0.27 

0.607 

0.024998 

4.95 

0.014 

0.000072 

0.01 

0.906 

0.012822 

2.54 

0.096 

0.000617 

0.12 

0.885 

0.000222 

0.005048 

0.04 

0.957 


Adj MS 


F 


p 

0 

.00883 

0 , 

.60 

0. 

.446 

0 

. 01077 

0 . 

.73 

0 . 

.400 

0 

.00596 

0, 

.40 

0 . 

. 672 

0 

.00917 

0 , 

. 62 

0 , 

.437 

0 

. 00289 

0 , 

.20 

0 , 

. 824 

0 

. 00257 

0 , 

.17 

0 , 

. 841 

0 

.00017 

0 , 

. 01 

0 , 

.988 

0 

.01480 






Adj MS 

F 

P 

0.017738 

2.90 

0.099 

0.015891 

2.60 

0.117 

0.000051 

0.01 

0.992 

0.015224 

2.49 

0.125 

0.020280 

3.32 

0.050 

0.022674 

3.71 

0.036 

0.003464 

0.006116 

0.57 

0.574 
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Analysis of Variance for ac45 


Source 

Class 

Stress 

Period 

Class*Stress 

Class*Period 

Stress*Period 

Class*Stress*Period 

Error 

Total 


Source 

Class 

Stress 

Period 

Class*Stress 

Class*Period 

Stress*Period 

Class*Stress*Period 

Error 

Total 


Source 

Class 

Stress 

Period 

Class*Stress 

Class*Period 

Stress*Period 

Class*Stress*Period 

Error 

Total 


Source 

Class 

Stress 

Period 

Class*Stress 

Class*Period 

Stress*Period 

Class*Stress*Period 

Error 

Total 


DF 

Seq SS 

Adj SS 

Adj MS 

1 

0.02019 

0.02019 

0.02019 

1 

0.05647 

0.06930 

0.06930 

2 

0.11624 

0.14808 

0.07404 

1 

0.03859 

0.03859 

0.03859 

2 

0.17813 

0.17813 

0.08906 

2 

0.01343 

0.01029 

0.00514 

2 

0.01106 

0.01106 

0.00553 

30 

0.63581 

0.63581 

0.02119 

41 

1.06991 



for 

ac46 



DF 

Seq SS 

Adj SS 

Adj MS 

1 

0.039114 

0.039114 

0.039114 

1 

0.002438 

0.004464 

0.004464 

2 

0.015576 

0.011873 

0.005936 

1 

0.015779 

0.015779 

0.015779 

2 

0.021615 

0.021615 

0.010808 

2 

0.055433 

0.060389 

0.030195 

2 

0.020475 

0.020475 

0.010237 

30 

0.219617 

0.219617 

0.007321 

41 

0.390048 



for 

ac47 



DF 

Seq SS 

Adj SS 

Adj MS 

1 

0.60467 

0.57400 

0.57400 

1 

0.00046 

0.00140 

0.00140 

2 

0.03627 

0.07591 

0.03795 

1 

0.00001 

0.00072 

0.00072 

2 

0.88155 

0.87971 

0.43985 

2 

0.00869 

0.01384 

0.00692 

2 

0.03379 

0.03379 

0.01689 

29 

1.43076 

1.43076 

0.04934 

40 

2.99621 



for 

ac48 



DF 

Seq SS 

Adj SS 

Adj MS 

1 

0.11552 

0.12057 

0.12057 

1 

0.03453 

0.03149 

0.03149 

2 

0.02319 

0.01441 

0.00721 

1 

0.02363 

0.03149 

0.03149 

2 

0.01642 

0.01441 

0.00721 

2 

0.08818 

0.06843 

0.03422 

2 

0.06843 

0.06843 

0.03422 

24 

0.94709 

0.94709 

0.03946 

35 

1.31700 




F P 

0.95 0.337 

3.27 0.081 

3.49 0.043 

1.82 0.187 
4.20 0.025 

0.24 0.786 

0.26 0.772 


F 

11.63 

0.03 

0.77 


P 

0.028 

0.441 

0.454 

0.152 

0.245 

0.026 

0.263 


P 

0.002 

0.867 

0.473 


0.01 0.905 
8.92 0.001 

0.14 0.870 

0.34 0.713 


F P 

3.06 0.093 

0.80 0.381 
0.18 0.834 
0.80 0.381 
0.18 0.834 
0.87 0.433 

0.87 0.433 


Analysis of Variance for ac49 


Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.00065 

0.00014 

0.00014 

0.01 

0.914 

Stress 

1 

0.00160 

0.00189 

0.00189 

0.17 

0.686 

Period 

2 

0.03110 

0.03421 

0.01711 

1.51 

0.239 

Class*Stress 

1 

0.00813 

0.00504 

0.00504 

0.44 

0.510 

Class*Period 

2 

0.01429 

0.01682 

0.00841 

0.74 

0.486 

Stress*Period 

2 

0.05789 

0.06245 

0.03123 

2.75 

0.081 

Class*Stress*Period 

2 

0.01527 

0.01527 

0.00764 

0.67 

0.518 

Error 

28 

0.31764 

0.31764 

0.01134 



Total 

39 

0.44658 






Analysis of Variance 

Source 

for ac50 

Model DF 

Reduced DF 

Seq SS 

Class 

1 

1 

0.06377 

Stress 

1 

1 

0.07501 

Period 

2 

2 

0.12762 

Class*Stress 

1 

1 

0.48601 

Class*Period 

2 

2 

0.32384 

Stress*Period 

2 

2 

0.22338 

Class*Stress*Period 

2 

1+ 

0.41926 

Error 

13 

14 

3.39205 

Total 

24 

24 

5.11094 


+ Rank deficiency due to empty cells, unbalanced nesting or 
collinearity. 

No storage of results or further analysis will be done. 


Analysis of Variance 

for 

ac51 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.00534 

0.00534 

0.00534 

0.45 

0.506 

Stress 

1 

0.00137 

0.00062 

0.00062 

0.05 

0.820 

Period 

2 

0.00030 

0.00187 

0.00093 

0.08 

0.924 

Class*Stress 

1 

0.00672 

0.00672 

0.00672 

0.57 

0.456 

Class*Period 

2 

0.13520 

0.13520 

0.06760 

5.75 

0.008 

Stress*Period 

2 

0.03576 

0.03709 

0.01854 

1.58 

0.223 

Class*Stress*Period 

2 

0.00436 

0.00436 

0.00218 

0.19 

0.832 

Error 

30 

0.35267 

0.35267 

0.01176 



Total 

41 

0.54171 






Analysis of Variance for ac52 


Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.08505 

0.03280 

0.03280 

0.34 

0.565 

Stress 

1 

0.04758 

0.00410 

0.00410 

0.04 

0.838 

Period 

2 

1.08085 

0.93096 

0.46548 

4.83 

0.017 

Class*Stress 

1 

0.06959 

0.06743 

0.06743 

0.70 

0.411 

Class*Period 

2 

0.28282 

0.26801 

0.13401 

1.39 

0.267 

Stress*Period 

2 

0.00468 

0.00218 

0.00109 

0.01 

0.989 

Class*Stress*Period 

2 

0.02919 

0.02919 

0.01459 

0.15 

0.860 

Error 

25 

2.40738 

2.40738 

0.09629 



Total 

36 

4.00713 
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Analysis of Variance for ac53 


Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.21029 

0.17857 

0.17857 

5.42 

0.027 

Stress 

1 

0.00160 

0.00325 

0.00325 

0.10 

0.756 

Period 

2 

0.15044 

0.20441 

0.10221 

3.10 

0.060 

Class*Stress 

1 

0.00737 

0.00432 

0.00432 

0.13 

0.720 

Class*Period 

2 

0.16767 

0.16882 

0.08441 

2.56 

0.094 

Stress*Period 

2 

0.06848 

0.06467 

0.03234 

0.98 

0.387 

Class*Stress*Period 

2 

0.06094 

0.06094 

0.03047 

0.93 

0.408 

Error 

29 

0.95477 

0.95477 

0.03292 



Total 

40 

1.62156 






Analysis of Variance 

for 

ac54 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.02095 

0.02792 

0.02792 

0.30 

0.589 

Stress 

1 

0.26264 

0.18814 

0.18814 

2.02 

0.168 

Period 

2 

0.11778 

0.08861 

0.04431 

0.47 

0.627 

Class*Stress 

1 

0.22249 

0.19988 

0.19988 

2.14 

0.155 

Class*Period 

2 

0.05711 

0.05663 

0.02831 

0.30 

0.741 

Stress*Period 

2 

0.09293 

0.09337 

0.04668 

0.50 

0.612 

Class*Stress*Period 

2 

0.01867 

0.01867 

0.00934 

0.10 

0.905 

Error 

26 

2.42741 

2.42741 

0.09336 



Total 

37 

3.21997 






Analysis of Variance 

for 

ac55 





Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

Class 

1 

0.02805 

0.02653 

0.02653 

0.34 

0.565 

Stress 

1 

0.00008 

0.00017 

0.00017 

0.00 

0.963 

Period 

2 

0.03658 

0.05172 

0.02586 

0.33 

0.721 

Class*Stress 

1 

0.01480 

0.01455 

0.01455 

0.19 

0.670 

Class*Period 

2 

0.08653 

0.07888 

0.03944 

0.50 

0.610 

Stress*Period 

2 

0.00996 

0.01529 

0.00764 

0.10 

0.907 

Class*Stress*Period 

2 

0.10618 

0.10618 

0.05309 

0.68 

0.516 

Error 

29 

2.27163 

2.27163 

0.07833 



Total 

40 

2.55382 






Analysis of Variance 

Source 

for ac56 

Model DF 

Reduced DF 

Seq SS 

Class 

1 

1 

0.382571 

Stress 

1 

1 

0.203710 

Period 

2 

2 

0.031686 

Class*Stress 

1 

1 

0.106279 

Class*Period 

2 

2 

0.029859 

Stress*Period 

2 

2 

0.017024 

Class*Stress*Period 

2 

0 + 

0.000000 

Error 

7 

9 

1.721933 

Total 

18 

18 

2.493063 


+ Rank deficiency due to empty cells, unbalanced nesting or 
collinearity. 

No storage of results or further analysis will be done. 
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APPENDIX F. TWO SAMPLE T-TEST FOR COMMUNICATION VARIABLES 

The following Appendix displays the results of the Two 
sample t-test for the communication variables. The results 
below are only those that contradicted the Univariate 
analysis of variance results. Some t-test results 

contradict in favor of a significant difference and some 
contradict against a significant difference. These 

contradictions were discussed in Chapter 4. 

Two Sample T-Test and Confidence Interval 

Twosample T for acl 

Class N Mean StDev SE Mean 

1 24 81.5 41.0 8.4 

2 18 62.7 23.2 5.5 

95% C.I. for mu 1- mu 2: ( -1.5, 39.1) 

T-Test mu 1 = mu 2 (vs not = ) : T= 1.88 P=0.068 DF= 37 


Twosample T for acl 

Stress N Mean StDev SE Mean 

1 21 65.3 34.5 7.5 

2 21 81.5 35.2 7.7 

95% C.I. for mu 1 - mu 2: ( -38.0, 5.5) 

T-Test mu 1 = mu 2 (vs not =): T= -1.51 P=0.14 DF= 39 


Twosample T for aclO 
Stress N Mean 

StDev 

SE Mean 

1 

21 2.40 

0.914 

0.20 

2 

21 3.02 

1.09 

0.24 


95% C.I. for mu 1 - mu 2: ( -1.24, 0.01) 

T-Test mu 1 = mu 2 (vs not =): T= -1.99 P=0.054 DF= 38 


Twosample T for acl5 

Stress N Mean StDev SE Mean 

1 21 1.578 0.90 0.20 

2 21 1.92 1.08 0.24 

95% C.I. for mu 1 - mu 2: ( -0.96, 0.28) 

T-Test mu 1 = mu 2 (vs not =): T= -1.11 P=0.27 DF= 38 


Twosample T for acl6 

Class N Mean StDev SE Mean 

1 24 0.992 0.659 0.13 

2 18 0.672 0.376 0.089 

95% C.I. for mu 1 - mu 2: ( -0.01, 0.646) 

T-Test mu 1 = mu 2 (vs not =): T- 1.98 P=0.055 DF= 37 
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StDev 

0.456 

0.726 


SE Mean 
0.10 
0.16 


Twosample T for acl7 
Stress N Mean 

1 21 0.882 

2 21 1.198 

95% C.I. for mu 1- mu 2: (-0.70, 0.06) 

T-Test mu 1 = mu 2 (vs not =): T= -1.69 P=0.10 DF= 33 


Twosample T for ac21 


Class 

N 

Mean 

StDev 

SE Mean 

1 

24 

1.154 

0.856 

0.17 

2 

18 

0.704 

0.609 

0.14 


Twosample T for ac33 

Stress N Mean StDev SE Mean 

1 21 0.213 0.154 0.034 

2 21 0.379 0.339 0.074 

95% C.I. for mu 1 - mu 2: ( -0.332, 0.001) 

T-Test mu 1 = mu 2 (vs not =): T= -2.04 P=0.051 DF= 27 


Twosample T for ac38 


Stress 

N 

Mean 

StDev 

SE Mean 

1 

21 

0.030 

0.067 

0.015 

2 

21 

0.099 

0.135 

0.030 


95% C.I. for mu 1 - mu 2: ( -0.136, -0.001) 

T-Test mu 1 = mu 2 (vs not =): T= -2.08 P=0.047 DF= 29 


Twosample T for ac40 

Stress N Mean StDev SE Mean 

1 21 1.199 0.492 0.11 

2 21 1.494 0.583 0.13 

95% C.I. for mu 1 - mu 2: (-0.63, 0.04) 

T-Test mu 1 = mu 2 (vs not =): T= -1.78 P=0.084 DF= 38 


Twosample T for ac46 

Class N Mean StDev SE Mean 

1 24 0.718 0.080 0.016 

2 18 0.657 0.109 0.026 

95% C.I. for mu 1 - mu 2: ( -0.001, 0.124) 

T-Test mu 1 = mu 2 (vs not =): T= 2.02 P=0.053 DF= 29 
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APPENDIX G- UNIVARIATE ANALYSIS OF VARIANCE FOR TEAMWORK 


The following Appendix displays the p-values for the 
dependent variables of teamwork across the independent 
variables of Class and Stress. 


General Linear Model 


Factor Levels Values 
class 212 

stress 212 


Analysis of Variance 


for atmwkl 


Source DF 
class 1 
stress 1 
class*stress 1 
Error 10 
Total 13 


Seq SS Adj SS 

31.201 31.201 

1.511 1.844 

0.975 0.975 

3.907 3.907 

37.594 


Adj MS F P 

31.201 79.87 0.000 

1.844 4.72 0.055 

0.975 2.50 0.145 

0.391 


Analysis of Variance for atmwk2 


Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

class 

1 

32.772 

32.772 

32.772 

193,15 

0.000 

stress 

1 

2.403 

2.429 

2.429 

14.32 

0.004 

class*stress 

1 

0.029 

0.029 

0.029 

0.17 

0.689 

Error 

10 

1.697 

1.697 

0.170 



Total 

13 

36.900 






Analysis of Variance for atmwk3 


Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

class 

1 

17.037 

17.037 

17.037 

11.67 

0.007 

stress 

1 

0.231 

0.081 

0.081 

0.06 

0.818 

class*stress 

1 

1.781 

1.781 

1.781 

1.22 

0.295 

Error 

10 

14.604 

14.604 

1.460 



Total 

13 

33.654 






Analysis of Variance for atmwk4 


Source 

DF 

Seq SS 

Adj SS 

Adj MS 

F 

P 

class 

1 

37.810 

37.810 

37.810 

206.52 

0.000 

stress 

1 

0.601 

0.656 

0.656 

3.58 

0.088 

class*stress 

1 

0.091 

0.091 

0.091 

0.49 

0.498 

Error 

10 

1.831 

1.831 

0.183 



Total 

13 

40.332 






145 


Analysis of Variance for atmwkS 


Source DF 
class 1 
stress 1 
class*stress 1 
Error 10 
Total 13 


Analysis of Variance 


Source DF 
class 1 
stress 1 
class*stress 1 
Error 10 
Total 13 


Analysis of Variance 


Source DF 
class 1 
stress 1 
class*stress 1 
Error 10 
Total 13 


Analysis of Variance 


Source DF 
class 1 
stress 1 
class*stress 1 
Error 10 
Total 13 


Analysis of Variance 


Source DF 
class 1 
stress 1 
class*stress 1 
Error 10 
Total 13 


Seg SS Ad: SS 

32.860 32.860 

0.778 0.871 

0.180 0.180 

2.154 2.154 

35.972 


for atmwk6 

Seg SS Adj SS 

18.4672 18.4672 

0.8750 0.9301 

0.0729 0.0729 

1.7542 1.7542 

21.1693 


for atmwk7 

Seg SS Adj SS 

18.5336 18.5336 

1.7150 1.6800 

0.0000 0.0000 

4.3550 4.3550 

24.6036 


for atmwk8 

Seg SS Adj SS 

22.5867 22.5867 

0.7314 0.6688 

0.0402 0.0402 

4.7817 4.7817 

28.1400 


for atmwk9 

Seg SS Adj SS 

14.881 14.881 

0.378 0.400 

0.029 0.029 

15.442 15.442 

30.729 


Adj MS F P 

32.860 152.54 0.000 

0.871 4.05 0.072 

0.180 0.84 0.382 

0.215 


Adj MS F P 

18.4672 105.28 0.000 

0.9301 5.30 0.044 

0.0729 0.42 0.534 

0.1754 


Adj MS F P 

18.5336 42.56 0.000 

1.6800 3.86 0.078 

0.0000 0.00 1.000 

0.4355 


Adj MS F P 

22.5867 47.24 0.000 

0.6688 1.40 0.264 

0.0402 0.08 0.778 

0.4782 


Adj MS F P 

14.881 9.64 0.011 

0.400 0.26 0.622 

0.029 0.02 0.894 

1.544 


Analysis of Variance for atmwklO 

Source DF Seg SS Adj SS Adj MS F P 

class 1 16.3438 16.3438 16.3438 19.73 0.001 

stress 1 0.7314 0.8288 0.8288 1.00 0.341 

class*stress 1 0.2002 0.2002 0.2002 0.24 0.634 

Error 10 8.2817 8.2817 0.8282 

Total 13 25.5571 
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Analysis of Variance for atmwkll 


Source DF 
class 1 
stress 1 
class*stress 1 
Error 10 
Total 13 

Analysis of Variance 

Source DF 
class 1 
stress 1 
class*stress 1 
Error 10 
Total 13 


Analysis of Variance 


Source DF 
class 1 
stress 1 
class*stress 1 
Error 10 
Total 13 


Analysis of Variance 

Source DF 
class 1 
stress 1 
class*stress 1 
Error 10 
Total 13 

Analysis of Variance 

Source DF 
class 1 
stress 1 
class*stress 1 
Error 10 
Total 13 


Seq SS Ad 3 SS 

18.667 18.667 

2.161 2.194 

0.034 0.034 

10.513 10.513 

31.375 

for atirwkX2 

Seq SS Adj SS 

14.1752 14.1752 

2.4029 2.9867 

1.8438 1.8438 

7.5067 7.5067 

25.9286 


for atmwkl3 

Seq SS Adj SS 

21.5001 21.5001 

0.7779 0.9601 

0.5601 0.5601 

7.1742 7.1742 

30.0121 


for atmwkl4 

Seq SS Adj SS 

33.840 33.840 

2.835 3.259 

0.945 0.945 

0.823 0.823 

38.444 

for atmwkl5 

Seq SS Adj SS 

31.029 31.029 

1.143 1.037 

0.077 0.077 

2.588 2.588 

34.837 


Ad 3 MS F P 

18.667 17.76 0.002 

2.194 2.09 0.179 

0.034 0.03 0.860 

1.051 


Adj MS F P 

14.1752 18.88 0.001 

2.9867 3.98 0.074 

1.8438 2.46 0.148 

0.7507 


Adj MS F P 

21.5001 29.97 0.000 

0.9601 1.34 0.274 

0.5601 0.78 0.398 

0.7174 


Adj MS F P 

33.840 411.02 0.000 

3.259 39.59 0.000 

0.945 11.48 0.007 

0.082 


Adj MS F P 

31.029 119.88 0.000 

1.037 4.01 0.073 

0.077 0.30 0.597 

0.259 
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APPENDIX H. MAIN EFFECTS P 









TAO Communication Rate 



Subordinate Communication Rate 



TIC Communication Rate 



S Class 
p* 0.132 


p = 0.469 


p = 0.948 
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Total Request Rate 



Total Transfer Rate 









Mean Transfers Ffcr Mirxto I Mean Requests Per Minute I Mean Acknowledgments Per Minute 



TotalTAO Request Rate 



p - 0.071 


L Stress H 
p = 0.013 


1 Period 3 
p = 0.816 




p = 0.012 


L Stress H 
p = 0.088 


1 Period 3 
p = 0.034 
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Mean ^quests RrMinUe Mean Ackncwrfedgments Per Minute 
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Mean A&T Per Minute Mean Information Per Minute Mean Acknowledgments Per Minute 










Mean PS&P Per Minute 


Total Problem Solving & Planning Rate 



TotalTAO Information Rate 



TAO Action & Task Rate 
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Mean PS&P Per Minute 


TAO Problem Solving & Planning Rate 



Total Subordinate Information Rate 



Total Subordinate Action & Task Rate 
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Mean Transfers Per Minute I Mean Requests FterMIrute I Mean PS&P Per Minute 


0.07 


Total Subordinate Problem Solving & Planning 


! I 

0.06 
0.05 

0.04 

0.03 

p = 0.534 p = 0.635 p = 0.260 



TAO information Request Rate 



TAO Information Transfer Rate 
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Mean Requests Per Minute Mean Transfers Per Minute 












Mean Transfers Per Minute Mean Requests Per Minute Mean Transfers Per Minute 










Mean Transfers Ffer Minute 


Sub 


[•JPl 


1.52 

1.44 

1.36 

1.28 

1.20 












T ransfers/Ftequests I T ransfers/Ftequests 


Overall Upward Anticipation Ratio 



Transfer Vs Request Anticipation Ratio 
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Transfers/ Raq uest s 




















T ransfers'Ftequests 
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fvtean Requests Per Mnute I Nfean Ctxrms Per Mnute 
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Nfean A&T Per Mnute 
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Class 


Transfer Vs Request Anticipation Ratio 



Superior 

Good 


Transfer Vs Request Anticipation Ratio 



Period 


\0 Transfer Vs Request Anticipation Ratio 

p = 0.025 Class 



»rd to Subord Info Transfers Vs Requests AR 


p = 0.008 



Period 


Class 

• Superior 
■ Good 
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Transf ers/Ftequests 
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APPENDIX J. BOXPLOTS FOR COMMUNICATION VARIABLES 

This Appendix displays the boxplots for those 
communication variables that only had marginal or 
significant results across the independent variables of 
Class, Stress, and Period. 




Utterances Per Scenario 



Total Communication Rate 



Superior Good 

Class 


Total Communication Rate 
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Total Transfer Rate 













Mean Trans f 



Total TAO Transfer Rate 



Total TAO Transfer Rate 



t i r 

12 3 

Period 






0 


Low 


High 







Mean Transfers Per Minute 


Total Subordinate Transfer Rate 



Low High 

Stress 


Total Subordinate Acknowledgment Rate 



4 


3 


2 


1 


0 



Superior Good 


Class 


Total Information Rate 
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Subordinate Information Rate 
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TAO Information Request Rate 






Mean Requests 


Subord Info Request Rate From TAO 



Subord A&T Transfer Rate To TAO 
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fers/Requests 


Subord Info To TAO Vs Requests by TAO 









d Info To TAO Vs Requests by TAO 



Period 
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APPENDIX K. NORMALITY PLOTS FOR COMMUNICATION VARIABLES 
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Norm ality P lot For TAO Transfer R ate 



Mean Transfers Per Minute 


Average: 1.04 Anderson-Darling NormalltyTe 

Std Dev: 0.619B86 A-Squared: 0.673 

Not data: 42 p-value: 0.073 
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